-- Logs begin at Thu 2022-07-28 02:36:39 UTC, end at Thu 2022-07-28 04:18:41 UTC. -- Jul 28 03:49:19.011900 dv-cinder-851279-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 03:49:19.021138 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 03:49:19 2022] *** Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: nodename: dv-cinder-851279-1-iscsi Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: machine: x86_64 Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: clock source: unix Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: pcre jit disabled Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: detected number of CPU cores: 4 Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: current working directory: / Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: your processes number limit is 47680 Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: your memory page size is 4096 bytes Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: detected max file descriptor number: 2048 Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: lock engine: pthread robust mutexes Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: thunder lock: enabled Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 03:49:19.023884 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 03:49:19.063892 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: Python main interpreter initialized at 0x559cbd6b19c0 Jul 28 03:49:19.063892 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: python threads support enabled Jul 28 03:49:19.063892 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: your server socket listen backlog is limited to 100 connections Jul 28 03:49:19.063892 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:49:19.064330 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:49:19.064330 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: *** Operational MODE: preforking *** Jul 28 03:49:19.064615 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:49:19.064615 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: spawned uWSGI master process (pid: 120722) Jul 28 03:49:19.064822 dv-cinder-851279-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 03:49:19.070108 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: spawned uWSGI worker 1 (pid: 120723, cores: 1) Jul 28 03:49:19.070108 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: spawned uWSGI worker 2 (pid: 120724, cores: 1) Jul 28 03:49:19.070108 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:49:19.725578 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:49:19.728212 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:49:20.810895 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:49:20.810895 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: from cryptography.utils import int_from_bytes Jul 28 03:49:20.811503 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:49:20.811503 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: from cryptography.utils import int_from_bytes Jul 28 03:49:20.816309 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:49:20.816309 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: from cryptography.utils import int_from_bytes Jul 28 03:49:20.816741 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:49:20.816741 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: from cryptography.utils import int_from_bytes Jul 28 03:49:23.310517 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:49:23.311085 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:49:23.311185 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:49:23.311529 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:49:23.311612 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:49:23.311682 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:49:23.311862 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:49:23.312018 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:49:23.312473 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:49:23.312578 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.312676 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:49:23.313101 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.313196 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.313288 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.313674 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.313783 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.313877 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.313963 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.314054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.314141 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.314221 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.314324 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.314462 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.314561 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.314750 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.314859 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.315040 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.315129 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.315348 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.315446 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.315607 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.315701 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-1-iscsi {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.315985 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.316138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.316268 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-1-iscsi {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.316370 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.316578 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.316665 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.316879 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.316963 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.317178 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.317265 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.317491 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.317578 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.317790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.317882 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.318109 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.318278 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.318414 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.318734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.318924 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.319048 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.319221 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.319314 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.319537 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.319641 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.319827 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.319964 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.320191 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.320292 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.320501 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.320589 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.320807 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.320906 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.321124 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.321217 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.321432 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.321542 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.321757 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.321861 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-1-iscsi {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.322063 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.322176 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.322465 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.322622 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-1-iscsi {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.322762 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.322894 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.323068 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.323157 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.323378 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.323486 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.323741 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.324465 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.324688 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.324812 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.324954 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.325045 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.325240 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.325329 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.325563 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.325706 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.325867 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.325973 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.326177 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.326310 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.326491 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.326578 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.326790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.326886 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.327091 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.327181 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.327391 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.327484 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.327696 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.327867 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.328010 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.328113 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.328333 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.328419 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.328610 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.328712 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.328914 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.329003 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.329159 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.329245 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.329465 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.329553 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.329795 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.329908 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.330071 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.330198 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.330298 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.330390 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.330614 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.330724 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.330888 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.330989 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.331187 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.331283 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.331499 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.331585 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.331806 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.331903 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.332128 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.332214 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.332428 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.332523 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.332727 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.332822 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.333025 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.333121 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.333325 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.333410 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.333630 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.333726 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.333933 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.334026 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.334241 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.334326 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.334542 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.334630 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.334861 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.334970 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.335166 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.335285 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.335485 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.335580 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.335821 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.335906 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.336139 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.336239 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.336443 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.336536 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.336766 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.336858 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.337080 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.337181 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.337385 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.337471 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.337685 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.337771 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.337988 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.338087 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.338289 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.338382 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.338590 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.338674 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.338893 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.338991 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.339198 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.339286 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.339550 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.339655 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.339807 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.339902 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.340101 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.340255 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.340399 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.340574 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.340733 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.340879 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.341002 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.341179 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.341306 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.341484 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.341594 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.341781 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.341905 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.342082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.342202 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.342382 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.342504 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.342680 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.342805 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.342979 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.343105 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.343277 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.343406 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.343575 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.343709 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.343875 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.344015 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.344200 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.344322 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.344499 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.344624 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.344811 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.344913 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.345127 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.345227 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.345424 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.345510 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.345722 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.345808 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.346021 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.346111 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.346319 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.346407 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.346657 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.346753 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.346954 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.347055 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.347253 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.347341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.347550 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.347648 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.347852 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.347940 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.348173 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.348269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.348480 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.348565 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.348780 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.348881 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.349077 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.349186 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.349374 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.349459 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.349671 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.349766 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.349970 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.350057 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.350269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.350366 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.350568 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.350655 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.350912 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.351030 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.351165 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.351267 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.351461 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.351557 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.351763 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.351857 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.352087 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.352192 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.352386 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.352473 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.352682 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.352779 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.352974 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.353071 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.353268 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.353361 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.353581 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.353669 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.353877 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.354041 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.354177 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.354275 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.354475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.354561 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.354778 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.354867 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.355626 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:49:23.355924 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.356228 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.356325 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.356568 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.356667 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.356902 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.356989 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.357214 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.357300 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.357543 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.357634 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.357868 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.357972 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.358175 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.358342 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.358488 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.358576 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.358803 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.358899 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.359122 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.359223 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.359429 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.359517 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.359737 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.359830 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.360070 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.360187 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.360390 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.360552 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.360716 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.360864 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.361009 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.361150 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.361298 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.361437 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.361603 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.361736 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.361911 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.362065 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.362223 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.362356 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.362538 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.362669 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.362854 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.362994 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.363159 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.363292 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.363495 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.363626 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.363859 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.364032 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.364240 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.364372 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.364551 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.364684 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.364867 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.365012 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.365176 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.365309 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.365484 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.365638 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.365787 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.365873 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.366088 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.366176 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.366406 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.366501 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.366711 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.366799 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.367025 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.367118 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.367334 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.367421 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.367641 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.367727 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.367945 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.368061 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.368272 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.368373 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.368578 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.368664 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.368889 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.368980 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.369199 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.369293 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.369511 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.369599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.369817 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.369904 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.370123 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.370222 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.370502 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.370721 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.371413 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.371500 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.371647 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.371873 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.371990 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.372075 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.372224 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.372327 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.372529 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.372619 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.372835 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.372923 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.373143 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.373231 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.373446 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.373535 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.373764 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.373852 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.374068 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.374154 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.374384 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.374480 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.374683 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.374777 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.374992 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.375089 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.375296 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.375385 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.375599 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.375685 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.375903 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.376055 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.376233 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.376322 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.376538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.376633 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.376841 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.376939 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.377141 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.377227 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.377453 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.377588 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.377757 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.377938 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.378057 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.378144 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.378365 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.378451 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.378667 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.378764 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.378971 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.379068 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.379276 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.379363 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.379581 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.379669 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.379886 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.380000 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.380221 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.380308 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.380542 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.380635 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.380839 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.380941 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.381145 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.381235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.381453 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.381545 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.381784 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.381882 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.382085 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.382174 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.382407 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.382496 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.382727 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.382820 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.383037 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.383133 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.383335 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.383424 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.383640 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.383727 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.383940 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.384065 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.384262 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.384354 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.384562 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.384656 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.384863 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.384959 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.385163 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.385250 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.385460 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.385546 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.385753 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.385849 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.386055 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.386153 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.386392 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.386667 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.386667 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.386834 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.386978 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.387147 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.387275 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.387463 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.387559 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.387771 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.387861 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.388102 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.388194 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.388407 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.388508 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.388750 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.388839 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.389057 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.389146 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.389399 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.389502 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.389731 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.389818 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.390039 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.390136 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.390351 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.390441 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.390658 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.390746 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.390967 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.391068 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.391272 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.391623 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.391833 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.391926 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.392168 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.392261 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.392476 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.392574 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.392796 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.392885 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.393103 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.393193 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.393422 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.393511 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.393726 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.393820 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.394038 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.394126 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.394337 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.394426 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.394647 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.394736 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.394950 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.395046 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.395267 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.395362 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.395592 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.395679 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.395909 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.396081 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.396239 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.396330 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.396550 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.396638 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.396856 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.396956 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.397158 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.397245 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.397463 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.397558 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.397770 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.397864 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.398079 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.398174 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.398383 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.398469 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.398695 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.398792 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.399003 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.399089 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.399319 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.399410 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.399625 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.399722 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.399939 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.400051 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.400261 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.400350 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.400572 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.400669 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.400912 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.401029 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.401185 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.401286 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.401508 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.401605 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.401816 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.401923 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.402161 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.402317 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.402476 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.402635 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.402782 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.402960 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.403088 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.403276 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.403392 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.403588 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.403696 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.403903 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.404045 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.404239 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.404329 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.404548 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.404635 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.404861 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.404948 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.405177 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.405266 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.405489 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.405576 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.405791 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.405877 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.406093 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.406183 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.406395 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.406494 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.406700 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.406863 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.407005 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.407101 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.407307 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.407393 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.407617 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.407711 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.407932 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.408051 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.408255 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.408350 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.408558 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.408655 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.408877 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.408965 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.409179 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.409269 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.409479 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.409586 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.409779 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.409869 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.410079 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.410180 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.410384 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.410472 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.410718 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.410818 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.410995 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.411087 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.411308 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.411429 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.411624 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.411735 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.411927 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.412038 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.412258 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.412348 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.412572 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.412660 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.412879 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.412967 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.413189 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.413285 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.413495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.413581 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.413800 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.413902 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.414110 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.414200 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.414418 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.414513 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.414723 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.414819 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.415026 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.415120 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.415333 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.415419 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.415634 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.415729 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.415939 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.416060 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.416268 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.416369 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.416570 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.416675 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.416874 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.416963 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.417180 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.417266 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.417487 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.418282 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.418435 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.418613 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.418789 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.418939 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.419223 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.419389 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.419520 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.419607 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.419828 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.419988 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.420180 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.420278 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.420496 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.420584 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.420814 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.420918 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.421124 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.421257 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.421433 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.421536 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.421737 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.421843 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.422039 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.422145 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.422347 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.422445 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.422649 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.422745 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.422951 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.423045 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.423250 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.423346 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.423554 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.423648 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.423851 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.423974 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.424177 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.424274 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.424478 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.424575 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.424779 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.424888 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.425080 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.425183 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.425378 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.425522 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.425659 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.425748 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.425969 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.426101 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.426269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.426400 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.426580 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.426725 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.426870 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.427016 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.427159 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.427302 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.427446 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.427592 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.427768 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.427900 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.428092 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.428226 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.428408 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.428539 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.428736 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.428879 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.429021 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.429152 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.429358 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.429492 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.429656 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.429787 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.429974 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.430107 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.430274 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.430407 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.430574 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.430706 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.430854 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.430991 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.431214 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.431350 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.431486 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.431621 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.431735 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.431833 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.432065 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.432158 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.432372 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.432458 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.432675 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.432774 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.432983 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.433076 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.433852 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.434005 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.434168 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.434273 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.434480 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.434576 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.434785 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.434874 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.435095 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.435193 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.435402 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.435489 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.435707 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.435794 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.436045 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.436141 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.436352 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.436439 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.436651 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.436736 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.436957 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.437053 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.437255 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.437341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.437553 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.437638 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.437854 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.437942 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.438159 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.438336 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.438523 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.438631 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.438754 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.438847 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.439058 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.439148 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.439356 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.439459 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.439663 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.439760 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.439980 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.440072 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.440287 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.440394 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.440589 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.440683 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.440895 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.440984 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.441199 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.441366 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.441509 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.441650 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.441784 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.441922 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.442060 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.442206 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.442356 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.442494 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.442669 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.442804 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.442977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.443120 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.443278 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.443414 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.443578 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.443718 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.443864 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.444032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.444194 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.444282 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.444492 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.444587 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.444792 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.444894 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.445090 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.445186 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.445391 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.445479 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.445686 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.445774 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.445984 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.446070 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.446288 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.446388 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.446583 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.446670 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.446884 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.446972 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.447182 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.447279 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.447484 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.447570 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.447790 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.447877 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.448119 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.448222 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.448453 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.448541 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.448752 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.448839 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.449089 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.449193 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.449398 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.449487 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.449705 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.449793 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.450013 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.450108 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.450313 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.450401 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.450622 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.450710 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.450929 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.451018 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.451230 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.451325 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.451528 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.451623 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.451824 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.451913 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.452167 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.452271 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.452471 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.452557 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.452774 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.452862 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.453088 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.453212 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.453396 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.453482 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.453708 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.453797 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.454004 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.454090 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.454308 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.454403 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.454614 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.454702 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.454920 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.455007 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.455223 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.455318 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.455525 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.455612 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.455830 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.455916 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.456159 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.456259 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.456466 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.456566 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.456769 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.456902 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.457076 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.457172 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.457374 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.457460 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.457679 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.457774 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.457984 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.458074 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.458345 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.458453 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.458588 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.458683 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.458897 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.458985 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.459191 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.459277 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.459495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.459582 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.459797 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.459888 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.460126 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.460215 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.460424 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.460528 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.460727 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.460848 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.461038 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.461156 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.461341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.461462 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.461762 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.461850 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.462068 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.462159 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.462374 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.462468 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.462682 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.462770 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.462989 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.463075 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.463285 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.463381 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.463599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.463686 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.463913 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.464033 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.464243 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.464341 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.464617 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.464712 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.464984 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.465070 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.465296 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.465393 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.465606 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.465693 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.465910 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.465997 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.466214 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.466302 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.466528 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.466666 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.466827 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.467017 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.467143 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.467289 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.467428 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.467517 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.467738 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.467890 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.468082 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.468193 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.468388 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.468477 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.468712 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.468808 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.469129 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.469226 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.469432 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.469519 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.469735 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.469832 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.470051 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.470145 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.470365 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.470454 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.470685 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.470782 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.470986 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.471076 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.471293 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.471380 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.471598 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.471703 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.471916 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.472037 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.472258 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.472356 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.472565 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.472654 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.472883 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.472982 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.473185 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.473273 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.473500 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.473598 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.473813 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.473909 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.474117 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.474204 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.474430 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.474516 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.474816 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.474913 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.475139 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.475227 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.475443 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.475530 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.475805 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.475903 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.476151 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.476240 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.476456 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.476558 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.476756 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.476844 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.477062 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.477150 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.477364 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.477465 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.477666 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.477761 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.477985 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.478075 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.478287 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.478388 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.478593 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.478682 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.478899 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.478994 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.479203 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.479299 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.479501 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.479587 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.479800 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.479887 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.480660 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.480773 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.481022 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.481119 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.481332 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.481419 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.481658 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.481754 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.481965 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.482060 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.482290 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.482378 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.482595 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.482683 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.482913 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.483011 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.483220 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.483309 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.483524 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.483612 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.483821 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.483908 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.484147 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.484249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.484474 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.484562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.484773 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.484860 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.485075 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.485171 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.485399 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.485487 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.485712 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.485818 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.486014 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.486117 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.486359 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.486501 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.486661 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.486755 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.486976 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.487079 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.487292 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.487384 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.487612 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.487701 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.487915 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.488047 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.488240 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.488329 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.488549 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.488638 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.488853 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.488942 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.489150 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.489236 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.489453 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.489549 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.489754 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.489842 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.490050 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.490143 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.490349 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.490442 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.490646 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.490734 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.490944 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.491051 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.491247 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.491366 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.491551 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.491649 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.491851 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.491938 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.492179 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.492329 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.492468 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.492554 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.492764 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.492854 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.493079 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.493179 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.493382 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.493482 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.493683 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.493778 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.494011 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.494107 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.494315 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.494414 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.494641 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.494729 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.494952 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.495042 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.495274 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.495364 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.495588 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.495716 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.496005 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.496182 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.496360 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.496538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.496662 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.496855 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.496974 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.497170 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.497284 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.497484 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.497582 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.497797 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.497897 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.498105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.498204 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.498418 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.498507 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.498730 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.498833 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.499043 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.499140 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.499364 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.499576 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.499719 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.499907 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.500221 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.500312 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.500675 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.500844 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.500952 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.501034 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.501157 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.501243 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.501468 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.501566 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.501780 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.501894 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.502092 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.502193 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.502399 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.502512 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.502706 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.502807 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.503018 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.503107 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.503327 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.503425 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.503648 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.503744 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.503992 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.504150 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.504324 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.504472 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.504659 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.504792 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.504967 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.505099 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.505279 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.505416 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.505593 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.505735 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.505909 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.506048 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.506215 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.506349 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.506527 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.506751 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.506892 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.507108 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.507280 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.507436 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.507522 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.507602 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.507716 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.507819 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.508050 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.508154 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.508363 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.508452 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.508673 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.508780 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.508980 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.509068 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.509289 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.509376 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.509594 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.509682 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.509904 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.509998 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.510219 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.510306 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.510531 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.510626 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.510840 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.510928 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.511150 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.512059 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.512213 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.512306 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.512494 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.512647 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.512808 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.512905 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.513137 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.513330 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.513465 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.513650 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.513786 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.513989 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.514100 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.514317 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.514413 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.514645 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.514733 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.514965 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.515055 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.515283 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.515370 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.515586 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.515682 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.515892 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.516001 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.516218 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.516556 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.516793 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.516925 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.517100 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.517200 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.517401 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.517741 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.517856 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.517956 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.518047 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.518136 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.518334 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.518513 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.518655 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.518858 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.518969 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.519171 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.519493 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.519580 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.519816 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.519906 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.520154 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.520246 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.520458 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.520553 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.520778 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.520868 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.521081 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.521170 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.521384 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.521472 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.521696 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.521786 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.522004 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.522092 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.522309 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.522417 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.522608 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.522739 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.522915 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.523005 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.523220 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.523315 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.523517 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.523604 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.523823 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.523910 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.524149 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.524251 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.524454 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.524542 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.524760 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.524855 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.525062 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.525163 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.525360 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.525449 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.525665 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.525752 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.525965 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.526063 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.526265 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.526353 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.526560 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.526647 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.526864 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.527514 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.527767 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.527867 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.528094 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.528214 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.528403 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.528494 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.528704 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.528792 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.529010 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.529096 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.529333 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.529473 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.529618 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.529764 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.529933 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.530066 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.530250 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.530386 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.530552 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.530698 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.530856 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.530998 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.531168 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.531301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.531476 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.531610 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.531794 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.531940 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.532127 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.532275 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.532456 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.532544 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.532760 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.532903 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.533072 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.533160 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.533386 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.533600 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.533763 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.533931 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.534081 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.534247 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.534576 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.534672 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.534904 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.535000 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.535209 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.535347 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.535509 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.535648 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.535833 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.535987 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.536142 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.536277 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.536450 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.536585 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.536755 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.536981 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.537116 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.537203 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.537394 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.537483 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.537705 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.537795 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.538011 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.538099 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.538316 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.538417 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.538621 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.538709 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.538925 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.539014 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.539229 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.539327 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.539535 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.539632 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.539840 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.539928 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.540169 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.540276 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.540474 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.540564 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.540783 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.540880 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.541096 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.541184 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.541407 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.541494 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.541717 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.541811 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.542027 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.542117 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.542338 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.542427 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.542725 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.542927 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.543010 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.543093 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.543309 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.543406 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.543619 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.543717 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.543929 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.544038 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.544261 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.544352 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.544568 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.544732 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.544866 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.544954 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.545197 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.545283 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.545510 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.545612 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.545817 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.545905 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.546168 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.546262 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.546474 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.546572 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.546792 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.546880 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.547110 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.547254 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.547414 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.547504 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.547730 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.547818 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.548065 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.548159 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.548375 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.548464 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.548696 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.548791 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.549007 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.549103 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.549320 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.549408 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.549620 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.549707 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.549921 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.550017 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.550220 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.550309 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.550525 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.550622 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.550835 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.550932 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.551140 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.551234 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.551440 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.551528 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.551737 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.551833 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.552074 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.552192 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.552371 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.552522 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.552707 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.552829 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.552956 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.553099 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.553259 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.553354 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.553564 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.553664 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.553860 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.553949 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.554160 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.554247 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.554456 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.554546 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.554753 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.554842 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.555052 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.555138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.555346 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.555441 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.555643 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.555737 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.555936 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.556077 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.556256 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.556353 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.556557 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.556704 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.556854 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.556951 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.557147 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.557235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.557446 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.557545 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.557749 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.557848 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.558051 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.558305 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.558410 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.558487 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.558694 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.558820 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.559011 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.559236 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.559414 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.559562 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.559681 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.559875 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.559991 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.560226 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.560323 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.560528 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.560636 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.560846 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.560934 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.561150 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.561237 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.561455 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.561552 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.561764 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.561858 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.562066 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.562153 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.562371 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.562461 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.562676 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.562788 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.562991 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.563077 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.563308 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.563411 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.563600 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.563688 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.563911 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.564059 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.564243 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.564391 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.564558 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.564648 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.564866 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.564961 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.565167 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.565256 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.565489 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.565578 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.565794 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.565897 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.566145 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.566248 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.566403 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.566498 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.566709 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.566806 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.567012 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.567102 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.567322 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.567455 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.567622 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.567718 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.567927 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.568074 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.568261 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.568388 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.568571 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.568693 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.568877 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.568991 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.569200 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.569506 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.569826 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.570148 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.570237 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.570486 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.570574 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.570792 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.570889 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.571120 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.571214 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.571441 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.571528 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.571749 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.571837 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.572085 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.572205 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.572388 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.572497 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.572626 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:49:23.572794 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.573106 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.573456 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.574322 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.574798 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.575167 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.575479 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:49:23.575728 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:49:23.726409 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO dbcounter [None req-63668151-d266-4957-a818-c82416e81f32 None None] Registered counter for database nova_api Jul 28 03:49:23.728628 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO dbcounter [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Registered counter for database nova_api Jul 28 03:49:23.747828 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_db.sqlalchemy.engines [None req-63668151-d266-4957-a818-c82416e81f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:49:23.749323 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG oslo_db.sqlalchemy.engines [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:49:23.754706 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writer thread running {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:49:23.755944 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writer thread running {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:49:23.812089 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.context [None req-63668151-d266-4957-a818-c82416e81f32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e515933-bed8-4837-a392-d3420c11c3a0(cell1) {{(pid=120723) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:49:23.812328 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.context [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e515933-bed8-4837-a392-d3420c11c3a0(cell1) {{(pid=120724) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:49:23.816212 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG oslo_concurrency.lockutils [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:23.816333 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63668151-d266-4957-a818-c82416e81f32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:23.817731 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG oslo_concurrency.lockutils [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:23.817834 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63668151-d266-4957-a818-c82416e81f32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:23.818515 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG oslo_concurrency.lockutils [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:23.818617 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63668151-d266-4957-a818-c82416e81f32 None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:23.820517 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG oslo_concurrency.lockutils [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:23.820613 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-63668151-d266-4957-a818-c82416e81f32 None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:23.822495 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO dbcounter [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Registered counter for database nova_cell0 Jul 28 03:49:23.822619 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO dbcounter [None req-63668151-d266-4957-a818-c82416e81f32 None None] Registered counter for database nova_cell0 Jul 28 03:49:23.828683 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO dbcounter [None req-63668151-d266-4957-a818-c82416e81f32 None None] Registered counter for database nova_cell1 Jul 28 03:49:23.828861 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO dbcounter [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Registered counter for database nova_cell1 Jul 28 03:49:23.835482 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG oslo_db.sqlalchemy.engines [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:49:23.837723 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_db.sqlalchemy.engines [None req-63668151-d266-4957-a818-c82416e81f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:49:23.840600 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writer thread running {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:49:23.842585 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_db.sqlalchemy.engines [None req-63668151-d266-4957-a818-c82416e81f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:49:23.842718 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG oslo_db.sqlalchemy.engines [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:49:23.844170 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writer thread running {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:49:23.982959 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writer thread running {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:49:23.983205 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writer thread running {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:49:23.991774 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO dbcounter [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Registered counter for database nova_cell0 Jul 28 03:49:23.991906 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO dbcounter [None req-63668151-d266-4957-a818-c82416e81f32 None None] Registered counter for database nova_cell0 Jul 28 03:49:24.001350 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_db.sqlalchemy.engines [None req-63668151-d266-4957-a818-c82416e81f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:49:24.004856 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG oslo_db.sqlalchemy.engines [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:49:24.005833 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writer thread running {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:49:24.009653 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writer thread running {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:49:24.428867 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: WARNING keystonemiddleware.auth_token [None req-63668151-d266-4957-a818-c82416e81f32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:49:24.436283 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: WARNING keystonemiddleware.auth_token [None req-63668151-d266-4957-a818-c82416e81f32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:49:24.559077 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: WARNING keystonemiddleware.auth_token [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:49:24.566549 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: WARNING keystonemiddleware.auth_token [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:49:24.772259 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: WARNING keystonemiddleware.auth_token [None req-63668151-d266-4957-a818-c82416e81f32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:49:24.779610 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: WARNING keystonemiddleware.auth_token [None req-63668151-d266-4957-a818-c82416e81f32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:49:24.785121 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559cbd6b19c0 pid: 120723 (default app) Jul 28 03:49:24.787388 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63668151-d266-4957-a818-c82416e81f32 None None] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:24.788623 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63668151-d266-4957-a818-c82416e81f32 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001936 Jul 28 03:49:24.789324 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Thu Jul 28 03:49:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:24.914777 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: WARNING keystonemiddleware.auth_token [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:49:24.921325 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: WARNING keystonemiddleware.auth_token [None req-d5d1df89-e62e-4fa7-9182-8273ed9b3719 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:49:24.926551 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559cbd6b19c0 pid: 120724 (default app) Jul 28 03:50:45.660035 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63668151-d266-4957-a818-c82416e81f32 None None] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:45.661197 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63668151-d266-4957-a818-c82416e81f32 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Jul 28 03:50:45.661873 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:50:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:45.673828 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writing DB stats nova_api:SELECT=3 {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:45.674977 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writing DB stats nova_cell1:SELECT=3 {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:45.676042 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writing DB stats nova_cell0:SELECT=3 {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:45.676821 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:46.590337 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-c097ea5d-b644-46e6-946a-c00165fb6cfe admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:46.624389 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-c097ea5d-b644-46e6-946a-c00165fb6cfe admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.955501 Jul 28 03:50:46.636005 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1291 bytes} [Thu Jul 28 03:50:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:48.852591 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-63668151-d266-4957-a818-c82416e81f32 None None] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:48.856180 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-63668151-d266-4957-a818-c82416e81f32 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003902 Jul 28 03:50:48.856592 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:49.345903 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-c3206240-cc22-4a18-bd70-bda799b9b5c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "id": "c1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:49.366307 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:50:49.366307 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: warnings.warn(msg) Jul 28 03:50:49.454937 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-c3206240-cc22-4a18-bd70-bda799b9b5c7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.591866 Jul 28 03:50:49.455486 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:50:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:50:49.470154 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:49.471364 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:49.472218 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=3 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:49.472929 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:49.679829 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d2090860-3fb1-4d59-ab69-ee3a7a692d04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:49.684862 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:50:49.684862 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: warnings.warn(msg) Jul 28 03:50:49.820131 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d2090860-3fb1-4d59-ab69-ee3a7a692d04 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.355432 Jul 28 03:50:49.821098 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jul 28 03:50:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:52.051340 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-c3206240-cc22-4a18-bd70-bda799b9b5c7 admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:52.053079 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-c3206240-cc22-4a18-bd70-bda799b9b5c7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002221 Jul 28 03:50:52.054006 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:52.741493 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cd53dc42-1871-4db2-bc57-1b1146f71ed5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:52.760486 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:50:52.760486 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: warnings.warn(msg) Jul 28 03:50:52.874459 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cd53dc42-1871-4db2-bc57-1b1146f71ed5 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.813334 Jul 28 03:50:52.875131 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:50:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:50:52.887397 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-4955ad2a-048b-4021-9b70-36a5a656c33d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:52.890497 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:50:52.890497 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: warnings.warn(msg) Jul 28 03:50:52.996852 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-4955ad2a-048b-4021-9b70-36a5a656c33d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113118 Jul 28 03:50:52.997638 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jul 28 03:50:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:55.285133 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cd53dc42-1871-4db2-bc57-1b1146f71ed5 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:55.286153 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cd53dc42-1871-4db2-bc57-1b1146f71ed5 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 28 03:50:55.286804 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:55.702354 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-0a589800-c3ad-46b6-a4d5-4122d5b191be admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:55.775008 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-0a589800-c3ad-46b6-a4d5-4122d5b191be admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482106 Jul 28 03:50:55.782990 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:50:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:50:55.788091 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-0a1f438e-b0fa-4848-a105-c774591d8dd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:55.876226 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-0a1f438e-b0fa-4848-a105-c774591d8dd7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091768 Jul 28 03:50:55.876924 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jul 28 03:50:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:58.115628 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-0a589800-c3ad-46b6-a4d5-4122d5b191be admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:58.116792 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-0a589800-c3ad-46b6-a4d5-4122d5b191be admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001911 Jul 28 03:50:58.117294 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:58.593363 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e8686f4-9f53-48b5-87a9-cea36d97c1dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "ram": 2048, "swap": 0, "id": "d3", "disk": 10}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:58.681032 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e8686f4-9f53-48b5-87a9-cea36d97c1dc admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.557099 Jul 28 03:50:58.681594 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:50:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:50:58.694685 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-cd0dd73b-4c0b-4412-bfd3-17519c98d2e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:58.780066 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-cd0dd73b-4c0b-4412-bfd3-17519c98d2e7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089681 Jul 28 03:50:58.780770 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jul 28 03:50:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:01.079215 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6e8686f4-9f53-48b5-87a9-cea36d97c1dc admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:01.080910 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6e8686f4-9f53-48b5-87a9-cea36d97c1dc admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002077 Jul 28 03:51:01.081312 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:01.531238 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6cc1e139-58e6-466c-97f9-2392b397256a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "swap": 0, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:01.641764 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6cc1e139-58e6-466c-97f9-2392b397256a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.554133 Jul 28 03:51:01.642324 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:51:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:51:01.654694 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c452ccc1-9852-499f-ae78-db98be619280 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:01.799252 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c452ccc1-9852-499f-ae78-db98be619280 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148307 Jul 28 03:51:01.799967 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1335 bytes} [Thu Jul 28 03:51:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:04.069248 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6cc1e139-58e6-466c-97f9-2392b397256a admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:04.070598 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6cc1e139-58e6-466c-97f9-2392b397256a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Jul 28 03:51:04.072278 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:51:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:04.545742 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d6452577-cf65-4186-8835-e0abee065466 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:04.570928 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d6452577-cf65-4186-8835-e0abee065466 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.492936 Jul 28 03:51:04.571616 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1291 bytes} [Thu Jul 28 03:51:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:07.148298 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6cc1e139-58e6-466c-97f9-2392b397256a admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:07.150737 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6cc1e139-58e6-466c-97f9-2392b397256a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 28 03:51:07.150737 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:51:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:51:07.599865 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d8409f8c-e710-44c3-8d7d-bd513d0164ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:07.725418 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d8409f8c-e710-44c3-8d7d-bd513d0164ba admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.568482 Jul 28 03:51:07.726104 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:51:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:51:07.740452 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-4089878d-86b7-4d21-a133-1cc40f4785bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:07.864555 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-4089878d-86b7-4d21-a133-1cc40f4785bf admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127885 Jul 28 03:51:07.865205 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jul 28 03:51:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:10.314668 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d8409f8c-e710-44c3-8d7d-bd513d0164ba admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:10.315674 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d8409f8c-e710-44c3-8d7d-bd513d0164ba admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 28 03:51:10.316272 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:51:10.730981 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6e33ca9b-cc43-47ee-970f-4ab245f3a9ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "disk": 20, "name": "m1.small", "swap": 0, "ram": 2048}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:10.851268 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6e33ca9b-cc43-47ee-970f-4ab245f3a9ff admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.529215 Jul 28 03:51:10.851863 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:51:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:51:10.865190 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-695078cc-146e-45ae-8329-72a2e0526b5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:11.041240 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-695078cc-146e-45ae-8329-72a2e0526b5b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.179799 Jul 28 03:51:11.041832 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jul 28 03:51:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:13.271816 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6e33ca9b-cc43-47ee-970f-4ab245f3a9ff admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:13.273484 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6e33ca9b-cc43-47ee-970f-4ab245f3a9ff admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Jul 28 03:51:13.273994 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:51:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:13.708211 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08ec2e89-8984-4795-94da-c364f365228f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "swap": 0, "id": "3"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:13.798743 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08ec2e89-8984-4795-94da-c364f365228f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.518696 Jul 28 03:51:13.799457 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:51:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:51:13.811404 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-07fb8c8e-0add-4d25-abfa-236d3e38640c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:13.910092 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-07fb8c8e-0add-4d25-abfa-236d3e38640c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102180 Jul 28 03:51:13.910711 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jul 28 03:51:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:16.202737 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-08ec2e89-8984-4795-94da-c364f365228f admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:16.204476 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-08ec2e89-8984-4795-94da-c364f365228f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002177 Jul 28 03:51:16.210457 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:16.636711 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-a6716615-f598-4823-83f0-48d78793b7f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:16.647437 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:16.751716 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-a6716615-f598-4823-83f0-48d78793b7f1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.540036 Jul 28 03:51:16.752625 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:51:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:51:16.765053 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-6b4e3fa0-cd63-463d-9aeb-127546d6c791 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:16.859379 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-6b4e3fa0-cd63-463d-9aeb-127546d6c791 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098516 Jul 28 03:51:16.873688 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jul 28 03:51:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:19.129999 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-a6716615-f598-4823-83f0-48d78793b7f1 admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:19.130850 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-a6716615-f598-4823-83f0-48d78793b7f1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 28 03:51:19.131414 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:19.582576 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea25155d-418f-4267-b6b4-6570031698e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:19.678027 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea25155d-418f-4267-b6b4-6570031698e2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.539308 Jul 28 03:51:19.678811 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1282 bytes} [Thu Jul 28 03:51:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:51:19.691364 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-0ebfc6af-c053-4496-a913-c6651f4370fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:19.784176 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-0ebfc6af-c053-4496-a913-c6651f4370fe admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096815 Jul 28 03:51:19.785614 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1332 bytes} [Thu Jul 28 03:51:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:39.639205 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea25155d-418f-4267-b6b4-6570031698e2 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:39.640258 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea25155d-418f-4267-b6b4-6570031698e2 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 28 03:51:39.640711 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:40.041169 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-93f51004-09c7-4fff-b747-f16c49f741cd admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:40.059496 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-93f51004-09c7-4fff-b747-f16c49f741cd admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.412868 Jul 28 03:51:40.060056 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1291 bytes} [Thu Jul 28 03:51:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:41.128447 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ea25155d-418f-4267-b6b4-6570031698e2 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:41.129457 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ea25155d-418f-4267-b6b4-6570031698e2 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 28 03:51:41.129861 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:41.679845 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-fcbcac15-f673-44a9-bcb0-c6d505da7e57 admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:41.685796 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.wsgi [None req-fcbcac15-f673-44a9-bcb0-c6d505da7e57 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-fcbcac15-f673-44a9-bcb0-c6d505da7e57 admin admin] Request method failure captured: Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Accept: application/json Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Accept-Encoding: gzip, deflate Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Connection: keep-alive Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Content-Length: 0 Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Host: 10.222.0.66 Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Openstack-Api-Version: compute 2.90 Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Openstack-System-Scope: None Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: User-Agent: python-novaclient Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Auth-Token: gAAAAABi4gfN-cFZsXSywYzXNHQjy1uYaw7OvOL9Mreq8a9cllJAvKh6roidClPlvSkHpM3WuBKGeBUM301-l5Ej74vWlHoHzDYdYvT386M03PhLP-aBkZwfWMeS5CZs09ytcHK7k7epEgZq-iwNJVv8nUe_n-mMCzu_S-x1o4OOJZ0uOWQ4Vz0 Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Domain-Id: None Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Domain-Name: None Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Identity-Status: Confirmed Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Is-Admin-Project: True Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Domain-Id: default Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Domain-Name: Default Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Name: admin Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Role: reader,member,admin Jul 28 03:51:41.689341 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Roles: reader,member,admin Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5ce7afae602945a39a04af885c7397db", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5ce7afae602945a39a04af885c7397db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}] Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Tenant: admin Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Tenant-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Tenant-Name: admin Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User: admin Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Domain-Id: default Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Domain-Name: Default Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Id: 2843150c6e564d5a84dbb71850deebd5 Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Name: admin Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: method: > Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: exception: Flavor 42 could not be found. Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: action_args: {'id': '42'} Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:41.691083 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:41.692249 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.693837 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-fcbcac15-f673-44a9-bcb0-c6d505da7e57 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:41.696213 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-fcbcac15-f673-44a9-bcb0-c6d505da7e57 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.418805 Jul 28 03:51:41.696681 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Jul 28 03:51:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:51:41.698924 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:41.703577 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-129c14be-2e01-4a6f-af72-37da8d8369c5 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:41.726704 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-129c14be-2e01-4a6f-af72-37da8d8369c5 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028020 Jul 28 03:51:41.732180 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jul 28 03:51:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:51:41.737800 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-bccde681-8e70-4e0f-b6f3-a5de4e625afe admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:41.763239 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-bccde681-8e70-4e0f-b6f3-a5de4e625afe admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029555 Jul 28 03:51:41.763799 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jul 28 03:51:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:41.773676 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abe0811f-0715-4965-8e77-27fad73b8329 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:41.779753 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-abe0811f-0715-4965-8e77-27fad73b8329 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abe0811f-0715-4965-8e77-27fad73b8329 admin admin] Request method failure captured: Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Accept: application/json Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Accept-Encoding: gzip, deflate Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Connection: keep-alive Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Content-Length: 0 Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Host: 10.222.0.66 Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Openstack-Api-Version: compute 2.90 Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Openstack-System-Scope: None Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: User-Agent: python-novaclient Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Auth-Token: gAAAAABi4gfN-cFZsXSywYzXNHQjy1uYaw7OvOL9Mreq8a9cllJAvKh6roidClPlvSkHpM3WuBKGeBUM301-l5Ej74vWlHoHzDYdYvT386M03PhLP-aBkZwfWMeS5CZs09ytcHK7k7epEgZq-iwNJVv8nUe_n-mMCzu_S-x1o4OOJZ0uOWQ4Vz0 Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Domain-Id: None Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Domain-Name: None Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Identity-Status: Confirmed Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Is-Admin-Project: True Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Domain-Id: default Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Domain-Name: Default Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Name: admin Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Role: reader,member,admin Jul 28 03:51:41.783138 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Roles: reader,member,admin Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5ce7afae602945a39a04af885c7397db", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5ce7afae602945a39a04af885c7397db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}] Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Tenant: admin Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Tenant-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Tenant-Name: admin Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User: admin Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Domain-Id: default Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Domain-Name: Default Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Id: 2843150c6e564d5a84dbb71850deebd5 Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Name: admin Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: method: > Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: exception: Flavor 42 could not be found. Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: action_args: {'id': '42'} Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:41.793734 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:41.794538 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:41.795606 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-abe0811f-0715-4965-8e77-27fad73b8329 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:41.796715 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-abe0811f-0715-4965-8e77-27fad73b8329 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014667 Jul 28 03:51:41.796715 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Jul 28 03:51:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:51:42.761210 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-bccde681-8e70-4e0f-b6f3-a5de4e625afe admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:42.764649 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-bccde681-8e70-4e0f-b6f3-a5de4e625afe admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001709 Jul 28 03:51:42.764649 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:43.293622 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc972344-83ef-40c5-a9fa-a6386e4bf5d3 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:43.299129 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-cc972344-83ef-40c5-a9fa-a6386e4bf5d3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc972344-83ef-40c5-a9fa-a6386e4bf5d3 admin admin] Request method failure captured: Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Accept: application/json Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Accept-Encoding: gzip, deflate Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Connection: keep-alive Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Content-Length: 0 Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Host: 10.222.0.66 Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Openstack-Api-Version: compute 2.90 Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Openstack-System-Scope: None Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: User-Agent: python-novaclient Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Auth-Token: gAAAAABi4gfOo8GxFYM0BxHZ2l9RlSiD4zqMBQlYeTAPJ5ksUYI8pH3XjUbgIXe0FhLsgNo-b3Au2PDGmVLBy-xix2DgS5_eTG7c4QHETJKRj7hp-cpFDyv000V7ETFkYaHe32ph1cvtVrqJ7qxfFpnlk50JeqxBTKv9uxMd6XDyCVwprcTsD-k Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Domain-Id: None Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Domain-Name: None Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Identity-Status: Confirmed Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Is-Admin-Project: True Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Domain-Id: default Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Domain-Name: Default Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Name: admin Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Role: reader,member,admin Jul 28 03:51:43.300654 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Roles: reader,member,admin Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5ce7afae602945a39a04af885c7397db", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5ce7afae602945a39a04af885c7397db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}] Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Tenant: admin Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Tenant-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Tenant-Name: admin Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User: admin Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Domain-Id: default Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Domain-Name: Default Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Id: 2843150c6e564d5a84dbb71850deebd5 Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Name: admin Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: method: > Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: exception: Flavor 84 could not be found. Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: action_args: {'id': '84'} Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:43.301977 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:43.302790 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.304495 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cc972344-83ef-40c5-a9fa-a6386e4bf5d3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:43.305846 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cc972344-83ef-40c5-a9fa-a6386e4bf5d3 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.401628 Jul 28 03:51:43.305846 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Jul 28 03:51:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:51:43.312427 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-7d0eadde-008b-4163-88e9-20f62a79c83b admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:43.327338 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-7d0eadde-008b-4163-88e9-20f62a79c83b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018435 Jul 28 03:51:43.327862 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jul 28 03:51:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:43.337540 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-198bb30b-8ec7-4d33-ab56-8ace515285f9 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:43.353159 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-198bb30b-8ec7-4d33-ab56-8ace515285f9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019301 Jul 28 03:51:43.353691 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jul 28 03:51:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:43.363006 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-16e6802d-4d57-4017-b740-2eea6a8d650c admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:43.369103 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.wsgi [None req-16e6802d-4d57-4017-b740-2eea6a8d650c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-16e6802d-4d57-4017-b740-2eea6a8d650c admin admin] Request method failure captured: Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Accept: application/json Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Accept-Encoding: gzip, deflate Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Connection: keep-alive Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Content-Length: 0 Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Host: 10.222.0.66 Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Openstack-Api-Version: compute 2.90 Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Openstack-System-Scope: None Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: User-Agent: python-novaclient Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Auth-Token: gAAAAABi4gfOo8GxFYM0BxHZ2l9RlSiD4zqMBQlYeTAPJ5ksUYI8pH3XjUbgIXe0FhLsgNo-b3Au2PDGmVLBy-xix2DgS5_eTG7c4QHETJKRj7hp-cpFDyv000V7ETFkYaHe32ph1cvtVrqJ7qxfFpnlk50JeqxBTKv9uxMd6XDyCVwprcTsD-k Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Domain-Id: None Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Domain-Name: None Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Identity-Status: Confirmed Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Is-Admin-Project: True Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Domain-Id: default Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Domain-Name: Default Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Name: admin Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Role: reader,member,admin Jul 28 03:51:43.370599 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Roles: reader,member,admin Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5ce7afae602945a39a04af885c7397db", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5ce7afae602945a39a04af885c7397db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}] Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Tenant: admin Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Tenant-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Tenant-Name: admin Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User: admin Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Domain-Id: default Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Domain-Name: Default Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Id: 2843150c6e564d5a84dbb71850deebd5 Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Name: admin Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: method: > Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: exception: Flavor 84 could not be found. Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: action_args: {'id': '84'} Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:43.372269 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:43.373235 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:43.374475 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-16e6802d-4d57-4017-b740-2eea6a8d650c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:43.375658 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-16e6802d-4d57-4017-b740-2eea6a8d650c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012429 Jul 28 03:51:43.375658 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Jul 28 03:51:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 03:51:44.345884 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-198bb30b-8ec7-4d33-ab56-8ace515285f9 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.346920 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-198bb30b-8ec7-4d33-ab56-8ace515285f9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 28 03:51:44.347316 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:44.884771 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-5f7fa1d7-0b05-4a9e-b6a8-3841169c0170 admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.890894 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.wsgi [None req-5f7fa1d7-0b05-4a9e-b6a8-3841169c0170 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-5f7fa1d7-0b05-4a9e-b6a8-3841169c0170 admin admin] Request method failure captured: Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Accept: application/json Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Accept-Encoding: gzip, deflate Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Connection: keep-alive Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Content-Length: 0 Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Host: 10.222.0.66 Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Openstack-Api-Version: compute 2.90 Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Openstack-System-Scope: None Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: User-Agent: python-novaclient Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Auth-Token: gAAAAABi4gfQJpXjXDy8XWuQwzzaiElIgmJwKE20z8G9FgbsdekkQcVsUFQrXoGgDv3GI8Aeed7mJoTQOGHtakVgwzoeZ3Ccpt5qoMpQkGtZSg8sGwpJzKlKhS3sSfhA-zFri0r6JHfaNBr6rR1db0vHGYYxD8mtK9uXtOuhJNQjI_tmO_Js15g Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Domain-Id: None Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Domain-Name: None Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Identity-Status: Confirmed Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Is-Admin-Project: True Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Domain-Id: default Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Domain-Name: Default Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Project-Name: admin Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Role: reader,member,admin Jul 28 03:51:44.892533 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Roles: reader,member,admin Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5ce7afae602945a39a04af885c7397db", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5ce7afae602945a39a04af885c7397db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}] Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Tenant: admin Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Tenant-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-Tenant-Name: admin Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User: admin Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Domain-Id: default Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Domain-Name: Default Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Id: 2843150c6e564d5a84dbb71850deebd5 Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: X-User-Name: admin Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: method: > Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: exception: Flavor 451 could not be found. Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: action_args: {'id': '451'} Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:44.894054 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:44.895032 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.896301 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-5f7fa1d7-0b05-4a9e-b6a8-3841169c0170 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:44.897689 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-5f7fa1d7-0b05-4a9e-b6a8-3841169c0170 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.408047 Jul 28 03:51:44.897689 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:51:44.903970 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cb4b6de2-cebd-442c-ab7d-172299642965 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.919848 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cb4b6de2-cebd-442c-ab7d-172299642965 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019503 Jul 28 03:51:44.920457 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:44.930581 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.945860 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019472 Jul 28 03:51:44.946443 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:44.955685 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f85f3b46-5457-4c75-b238-51c01b00e0ce admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.961088 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.wsgi [None req-f85f3b46-5457-4c75-b238-51c01b00e0ce admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f85f3b46-5457-4c75-b238-51c01b00e0ce admin admin] Request method failure captured: Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Accept: application/json Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Accept-Encoding: gzip, deflate Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Connection: keep-alive Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Content-Length: 0 Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Host: 10.222.0.66 Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Openstack-Api-Version: compute 2.90 Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Openstack-System-Scope: None Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: User-Agent: python-novaclient Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Auth-Token: gAAAAABi4gfQJpXjXDy8XWuQwzzaiElIgmJwKE20z8G9FgbsdekkQcVsUFQrXoGgDv3GI8Aeed7mJoTQOGHtakVgwzoeZ3Ccpt5qoMpQkGtZSg8sGwpJzKlKhS3sSfhA-zFri0r6JHfaNBr6rR1db0vHGYYxD8mtK9uXtOuhJNQjI_tmO_Js15g Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Domain-Id: None Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Domain-Name: None Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Identity-Status: Confirmed Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Is-Admin-Project: True Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Domain-Id: default Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Domain-Name: Default Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Project-Name: admin Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Role: reader,member,admin Jul 28 03:51:44.962562 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Roles: reader,member,admin Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5ce7afae602945a39a04af885c7397db", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5ce7afae602945a39a04af885c7397db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5ce7afae602945a39a04af885c7397db"}]}] Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Tenant: admin Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Tenant-Id: 5ce7afae602945a39a04af885c7397db Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-Tenant-Name: admin Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User: admin Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Domain-Id: default Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Domain-Name: Default Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Id: 2843150c6e564d5a84dbb71850deebd5 Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: X-User-Name: admin Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: method: > Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: exception: Flavor 451 could not be found. Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: action_args: {'id': '451'} Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:44.964105 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:44.965082 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: ERROR nova.api.openstack.wsgi Jul 28 03:51:44.966579 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-f85f3b46-5457-4c75-b238-51c01b00e0ce admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:44.967782 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-f85f3b46-5457-4c75-b238-51c01b00e0ce admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011806 Jul 28 03:51:44.967782 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:51:45.937516 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:45.938522 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 28 03:51:45.938928 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:46.469715 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-4c1c85e0-9961-446c-8f72-34305f451b8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:46.544115 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-4c1c85e0-9961-446c-8f72-34305f451b8f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.464240 Jul 28 03:51:46.544684 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Jul 28 03:51:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:51:47.519524 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:47.520550 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 28 03:51:47.520948 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:51:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:48.054355 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ee0754fd-a0a0-4dc9-b28d-2b6b0671f250 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:48.140888 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ee0754fd-a0a0-4dc9-b28d-2b6b0671f250 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.478778 Jul 28 03:51:48.141479 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Jul 28 03:51:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:51:49.115734 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:49.116776 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 28 03:51:49.117173 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:49.654150 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5b388c85-0beb-4224-9c98-09f553e23df0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:49.738265 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5b388c85-0beb-4224-9c98-09f553e23df0 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.480309 Jul 28 03:51:49.739038 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Jul 28 03:51:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:51:50.730051 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:50.731079 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 28 03:51:50.731503 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:51.252665 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-cbe42712-ae11-415d-95da-0bdab9115b82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:51.331964 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-cbe42712-ae11-415d-95da-0bdab9115b82 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.462754 Jul 28 03:51:51.332529 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Jul 28 03:51:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:51:52.311657 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:52.312719 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 28 03:51:52.313115 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:52.840516 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c79a2275-cfda-4f9e-8294-049c9a7353e5 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:52.861854 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c79a2275-cfda-4f9e-8294-049c9a7353e5 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410521 Jul 28 03:51:52.862329 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Thu Jul 28 03:51:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:46.055819 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.055819 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-6fa78241-8e16-45be-b1a7-6e708f24f28f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 28 03:52:46.055819 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 930 bytes} [Thu Jul 28 03:52:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:46.066296 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:46.484568 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-5a4641f2-2bb0-4033-981e-56fe4ffab702 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.507434 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-5a4641f2-2bb0-4033-981e-56fe4ffab702 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.445516 Jul 28 03:52:46.508019 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1291 bytes} [Thu Jul 28 03:52:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:46.529259 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG dbcounter [-] [120724] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=120724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:46.533033 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-3ce7bc3b-86d7-4130-a800-cac340983f9a admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.541129 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-3ce7bc3b-86d7-4130-a800-cac340983f9a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013382 Jul 28 03:52:46.549015 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1282 bytes} [Thu Jul 28 03:52:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:46.554415 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c3486ffd-8101-4f3e-ad33-3325471a2239 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.562137 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c3486ffd-8101-4f3e-ad33-3325471a2239 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011869 Jul 28 03:52:46.562670 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1285 bytes} [Thu Jul 28 03:52:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:46.575685 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.584138 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011968 Jul 28 03:52:46.584706 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1285 bytes} [Thu Jul 28 03:52:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:46.596486 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-36ada209-0000-4109-a843-27a01c6a89e6 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.605340 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-36ada209-0000-4109-a843-27a01c6a89e6 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012362 Jul 28 03:52:46.605908 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1282 bytes} [Thu Jul 28 03:52:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:43.062800 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:43.063855 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 28 03:56:43.064293 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:43.208945 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=6 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:43.356454 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-91cc7cc5-c5a0-4a75-889c-e34047530474 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:43.358795 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:56:43.358795 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: warnings.warn(msg) Jul 28 03:56:43.360054 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91cc7cc5-c5a0-4a75-889c-e34047530474 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:43.360500 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91cc7cc5-c5a0-4a75-889c-e34047530474 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:43.361290 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91cc7cc5-c5a0-4a75-889c-e34047530474 admin admin] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:43.361720 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-91cc7cc5-c5a0-4a75-889c-e34047530474 admin admin] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:43.396982 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-91cc7cc5-c5a0-4a75-889c-e34047530474 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.189407 Jul 28 03:56:43.397563 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jul 28 03:56:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:56:44.249042 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:44.250332 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Jul 28 03:56:44.250739 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:44.445124 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-c7230609-f982-4661-864d-6e6a41c5a6e1 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:44.448181 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:56:44.448181 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: warnings.warn(msg) Jul 28 03:56:44.449698 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7230609-f982-4661-864d-6e6a41c5a6e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.450403 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7230609-f982-4661-864d-6e6a41c5a6e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.450940 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7230609-f982-4661-864d-6e6a41c5a6e1 admin admin] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.451357 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-c7230609-f982-4661-864d-6e6a41c5a6e1 admin admin] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.472164 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-c7230609-f982-4661-864d-6e6a41c5a6e1 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081016 Jul 28 03:56:44.472743 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 37/72] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jul 28 03:56:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:56:55.731843 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:55.732902 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jul 28 03:56:55.733298 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:56:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:55.880390 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell0:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:55.881131 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_cell1:SELECT=4 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:55.881757 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG dbcounter [-] [120723] Writing DB stats nova_api:SELECT=8 {{(pid=120723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:55.933886 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-d0059432-dbb3-4c71-92f3-daae000d0894 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:55.936404 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:56:55.936404 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: warnings.warn(msg) Jul 28 03:56:55.937601 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0059432-dbb3-4c71-92f3-daae000d0894 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:55.938037 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0059432-dbb3-4c71-92f3-daae000d0894 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:55.938823 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0059432-dbb3-4c71-92f3-daae000d0894 admin admin] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:55.939240 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-d0059432-dbb3-4c71-92f3-daae000d0894 admin admin] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:55.965936 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-d0059432-dbb3-4c71-92f3-daae000d0894 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089915 Jul 28 03:56:55.966509 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 38/74] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jul 28 03:56:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:56.810705 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: DEBUG nova.api.openstack.wsgi [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] Calling method '>' {{(pid=120724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:56.811704 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: INFO nova.api.openstack.requestlog [None req-cf5e10be-e52e-4777-bf75-ce29dd3ce9fe admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 28 03:56:56.812123 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: [pid: 120724|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Jul 28 03:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:57.008590 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG nova.api.openstack.wsgi [None req-ca27ed3b-bced-46e0-92eb-a3f3ef0d68e0 admin admin] Calling method '>' {{(pid=120723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:57.011300 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:56:57.011300 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: warnings.warn(msg) Jul 28 03:56:57.012561 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca27ed3b-bced-46e0-92eb-a3f3ef0d68e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:57.013006 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca27ed3b-bced-46e0-92eb-a3f3ef0d68e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:57.013821 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca27ed3b-bced-46e0-92eb-a3f3ef0d68e0 admin admin] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:57.014246 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: DEBUG oslo_concurrency.lockutils [None req-ca27ed3b-bced-46e0-92eb-a3f3ef0d68e0 admin admin] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:57.036644 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: INFO nova.api.openstack.requestlog [None req-ca27ed3b-bced-46e0-92eb-a3f3ef0d68e0 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082468 Jul 28 03:56:57.037116 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: [pid: 120723|app: 0|req: 39/76] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Jul 28 03:56:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:52.808734 dv-cinder-851279-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 03:57:52.809672 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: Thu Jul 28 03:57:52 2022 - graceful shutdown triggered... Jul 28 03:57:52.810368 dv-cinder-851279-1-iscsi devstack@n-api.service[120723]: Gracefully killing worker 1 (pid: 120723)... Jul 28 03:57:52.810829 dv-cinder-851279-1-iscsi devstack@n-api.service[120724]: Gracefully killing worker 2 (pid: 120724)... Jul 28 03:57:53.810712 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: worker 1 buried after 1 seconds Jul 28 03:57:53.811264 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: worker 2 buried after 1 seconds Jul 28 03:57:53.811264 dv-cinder-851279-1-iscsi devstack@n-api.service[120722]: goodbye to uWSGI. Jul 28 03:57:53.812366 dv-cinder-851279-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 03:57:53.812913 dv-cinder-851279-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 03:57:53.815721 dv-cinder-851279-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 03:57:53.826711 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 03:57:53.829416 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 03:57:53 2022] *** Jul 28 03:57:53.829570 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:57:53.829724 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:57:53.829859 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: nodename: dv-cinder-851279-1-iscsi Jul 28 03:57:53.829981 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: machine: x86_64 Jul 28 03:57:53.830101 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: clock source: unix Jul 28 03:57:53.830213 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: pcre jit disabled Jul 28 03:57:53.830325 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: detected number of CPU cores: 4 Jul 28 03:57:53.830437 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: current working directory: / Jul 28 03:57:53.830547 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:57:53.830669 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: your processes number limit is 47680 Jul 28 03:57:53.830798 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: your memory page size is 4096 bytes Jul 28 03:57:53.830919 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: detected max file descriptor number: 2048 Jul 28 03:57:53.831033 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: lock engine: pthread robust mutexes Jul 28 03:57:53.831309 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: thunder lock: enabled Jul 28 03:57:53.831626 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 03:57:53.831835 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 03:57:53.873026 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: Python main interpreter initialized at 0x55aeca8d29c0 Jul 28 03:57:53.873026 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: python threads support enabled Jul 28 03:57:53.873026 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: your server socket listen backlog is limited to 100 connections Jul 28 03:57:53.873026 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:57:53.873486 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:57:53.873486 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: *** Operational MODE: preforking *** Jul 28 03:57:53.873750 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:57:53.873750 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: spawned uWSGI master process (pid: 135689) Jul 28 03:57:53.873966 dv-cinder-851279-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 03:57:53.874668 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: spawned uWSGI worker 1 (pid: 135703, cores: 1) Jul 28 03:57:53.874919 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: spawned uWSGI worker 2 (pid: 135704, cores: 1) Jul 28 03:57:53.875344 dv-cinder-851279-1-iscsi devstack@n-api.service[135689]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:57:54.555852 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:57:54.565960 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:57:55.744441 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:57:55.744441 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: from cryptography.utils import int_from_bytes Jul 28 03:57:55.745133 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:57:55.745133 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: from cryptography.utils import int_from_bytes Jul 28 03:57:55.757241 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:57:55.757241 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: from cryptography.utils import int_from_bytes Jul 28 03:57:55.758045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:57:55.758045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: from cryptography.utils import int_from_bytes Jul 28 03:57:58.205782 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:57:58.206400 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:57:58.206498 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:57:58.206841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:57:58.207104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:57:58.207495 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.207827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.208180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.208505 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.208841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.209154 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.209548 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.209883 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.210214 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.210482 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.210811 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.211400 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-1-iscsi {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.211512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.211922 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.212270 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.212603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.212934 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.213249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.213573 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.214090 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.215738 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.215738 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.215738 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.215738 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.216265 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.216265 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.216553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.216754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.217083 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.217445 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.217808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-1-iscsi {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.218128 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.218461 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.218770 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.219191 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.219517 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.219835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.220188 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.220513 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.224616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.224616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.224616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.224616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.224616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.224616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.224616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.224616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.225678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.225678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.225678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.225678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.225678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.225678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.225678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.226135 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.226666 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.226920 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.227270 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.227583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.227902 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.228247 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.228566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.228877 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.229190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.229505 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.229816 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.229915 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:57:58.230442 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.230529 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:57:58.230602 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.230802 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.230910 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:57:58.231079 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.231263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:57:58.231411 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.231605 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:57:58.231775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.232023 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.232261 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.232456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.232614 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.232770 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.232913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.233064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.233236 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.233418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.233587 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.233776 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.233932 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.234084 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.234237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.234389 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.234539 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.234700 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.234844 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.234992 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.235152 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.235304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.235449 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.235604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-1-iscsi {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.235754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.235905 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.236092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.236092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.236380 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.236535 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.236679 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.236830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.236981 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.237125 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.237281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.237438 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.237603 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.237760 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.237914 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.238066 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.238237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.238394 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.238570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.238726 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.238870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.239014 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.239173 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.239335 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.239942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.240154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.241844 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.242017 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.242171 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.242323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.242484 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.242640 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.242793 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.242944 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.243088 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.243250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.243405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.243549 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.243691 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.243837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-1-iscsi {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.244002 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.244174 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.244319 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.244464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.244607 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.244750 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.244906 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.244906 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.245221 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.245377 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.245531 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.245681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.245839 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.246010 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.246417 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.246575 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.246721 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.246864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.247015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.247159 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.247310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.247479 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.247735 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.247883 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.248048 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.255629 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.255825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.256147 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.256611 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.256786 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.256942 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.257094 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.257253 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.257454 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.257654 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.257801 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.257954 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.258169 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.258355 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.258355 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.258646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.258800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.258943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.259086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.259239 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.259399 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.259555 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.259555 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.259843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.259843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.260177 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.260369 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.260546 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.261125 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.261468 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.262077 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.262762 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.262941 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.263101 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.263255 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.263415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.263573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.263725 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.263877 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.264078 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.264233 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.264386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.264539 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.264690 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.264843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.265003 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.265155 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.265313 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.265465 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.265465 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.265743 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.265889 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.266070 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.266240 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.266393 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.266545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.266697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.266697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.266997 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.266997 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.267299 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.267462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.270251 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.270430 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.270600 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.270600 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.271287 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.271287 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.271712 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.273009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.273302 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.273527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.273684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.273841 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.273988 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.274139 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.274373 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.274527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.274679 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.274824 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.274974 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.275126 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.275281 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.275446 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.275599 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.275751 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.275895 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.276078 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.276226 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.276371 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.276514 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.276666 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.276810 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.276962 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.277114 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.277265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.277420 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.277570 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.277570 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.277858 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.278010 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.278158 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.278310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.278462 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.278621 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.278778 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.278930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.279079 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.279231 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.279393 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.279899 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.280090 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.280247 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.280391 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.280542 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.280686 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.280846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.281011 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.281477 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.281659 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.281911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.282476 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.282870 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.283281 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.283442 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.283596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.283751 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.283897 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.284086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.284235 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.284388 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.284547 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.284698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.284915 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.285062 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.285185 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.285306 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.285429 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.285550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.285670 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.285790 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.285902 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.286049 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.286174 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.286319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.286570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.286716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.286881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.287030 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.287150 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.287272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.287392 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.287513 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.288301 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.288588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.288760 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.288917 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.288917 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.289201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.289358 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.289518 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.289677 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.289831 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.289984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.290129 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.290272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.290416 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.290577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.290730 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.291823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.291823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.292322 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.292496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.292784 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.293152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.293570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.293732 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.293879 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.294037 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.294191 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.294342 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.294487 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.294631 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:57:58.294776 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.294983 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.295142 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.295289 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.295433 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.295577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.295728 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.295886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.296059 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.296218 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.296375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.296521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.296671 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.296830 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.296982 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.297138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.297291 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.297437 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.297594 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.297776 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.297933 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.298086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.298237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.298394 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.298550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.298695 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.298839 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.298995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.299139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.299289 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.299449 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.299602 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.299754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.299907 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.300075 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.300239 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.300385 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.300530 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.300674 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.300819 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.300981 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.301141 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.301285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.301438 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.301591 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.302071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.302339 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.302501 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.302649 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.302919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.304201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.304326 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.304429 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.304535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.304633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.304721 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.304805 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.304889 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305052 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305232 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305395 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305491 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305591 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305665 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305742 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305820 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305897 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.305986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306075 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306244 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306334 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306418 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306506 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306598 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306689 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.306957 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307043 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307128 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307128 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307286 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307457 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307633 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307709 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307779 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.307965 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308069 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308151 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308222 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308305 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308378 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308452 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308536 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308608 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308608 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308730 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308730 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.308942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309021 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309091 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309158 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309158 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309434 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309434 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309848 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.309996 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310067 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310144 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310294 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310610 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310690 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310768 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310838 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310906 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.310982 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311061 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311141 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311219 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311290 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311365 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311448 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311519 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311595 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311670 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311818 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311900 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.311992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312142 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312212 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312288 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312370 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312509 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312585 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312662 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312744 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312903 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.312974 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313049 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313204 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313281 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313418 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313486 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313561 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313793 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.313938 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314013 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314096 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314166 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.314789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315298 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315373 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315450 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315521 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315601 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315746 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315819 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315898 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.315988 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316078 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316151 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316227 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316296 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316369 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316463 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316555 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316639 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316729 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.316820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317812 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.317889 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.318223 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.318360 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.318563 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.318792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.319001 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.319172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.319333 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.319565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.319664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.320592 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.320775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.320869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.320986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.321187 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.321274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.321488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.321835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.322156 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.322429 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.322581 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.322771 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.322932 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.323088 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.323240 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.323385 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.323530 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.323674 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.323828 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.324065 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.324219 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.324370 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.324565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.324717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.324907 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.325071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.325218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.325370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.325515 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.325668 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.325829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.325994 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.326139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.326283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.326558 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.326704 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.326835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.326975 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.327218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.327536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.327684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.334587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.335163 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.335695 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.337067 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.342176 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.342363 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.342529 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.342700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.342867 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.343046 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.343204 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.343358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.343537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.343692 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.343844 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.344057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.344234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.344389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.344389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.344698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.344850 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.345098 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.345259 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.345412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.345576 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.345750 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.345903 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.346056 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.346230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.346403 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.346572 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.346734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.346896 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.347057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.347218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.347381 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.347541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.347696 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.347849 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.348033 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.348202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.348376 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.348556 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.348556 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.348951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.348951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.349465 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.349710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.349975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.350178 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.350426 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.350611 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.350866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.351036 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.351210 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.351447 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.351609 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.351772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.352003 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.352183 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.352542 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.352711 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.352876 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.353043 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.353208 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.353362 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.353516 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.353682 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.353842 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.354012 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.354180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.354341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.354502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.354655 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.354850 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.355009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.355307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.355468 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.355640 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.355795 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.355982 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.355982 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.356296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.356461 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.356625 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.356786 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.356946 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.357114 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.357269 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.357420 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.357580 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.357733 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.357881 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.358006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.358173 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.358289 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.358404 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.358518 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.358639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.358789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.358996 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.359124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.359338 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.359459 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.359587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.359729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.359943 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.360169 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.363137 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.363308 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.363520 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.363678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.363838 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.364035 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.364196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.364350 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.364519 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.364683 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.364850 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.365004 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.365156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.365327 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.365600 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.366306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.366462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.366616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.366770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.366938 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.367093 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.367245 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.367398 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.367564 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.367739 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.368053 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.368236 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.368395 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.368555 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.368716 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.368869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.369170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.369170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.369577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.369577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.369916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.370263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.370439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.370439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.370858 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.371368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.371535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.371704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.371704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.372067 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.372239 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.372401 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.372555 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.372999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.373170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.373170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.373473 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.373473 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.374386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.374550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.374712 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.374877 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.375032 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.375194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.375375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.375887 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.376081 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.376257 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.376421 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.376584 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.376745 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.376914 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.377070 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.377232 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.377394 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.377548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.377711 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.377879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.378042 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.378203 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.378360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.378512 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.378675 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.378675 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.378975 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.379148 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.379405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.379593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.379931 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.380143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.380568 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.380847 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.381009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.381324 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.382006 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.382006 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.382320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.382521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.382690 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.383096 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.383268 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.383427 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.383601 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.383764 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.383927 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.384142 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.384307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.384471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.384625 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.384786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.384940 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.385103 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.385258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.385412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.385565 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.385730 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.385904 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.386204 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.386519 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.386695 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.386861 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.387022 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.387189 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.387345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.387498 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.387912 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.388111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.388287 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.388466 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.388631 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.388785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.388931 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.389110 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.389273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.389553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.389742 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.390015 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.390114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.390211 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.390299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.390412 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.390521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.390608 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.390694 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.391168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.391297 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.391385 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.391465 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.391561 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.391657 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.391744 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.391839 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.391839 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.392235 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.392381 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.392516 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.392651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.392800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.392950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393083 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393174 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393261 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393454 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393637 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393730 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.393931 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394019 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394100 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394174 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394359 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394636 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394789 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394869 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.394968 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395055 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395479 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395744 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.395942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.396102 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.396361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.396473 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.396621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.396713 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.396808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.397441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.397608 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.397758 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.397861 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.397950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398049 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398141 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398227 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398586 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398673 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398849 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.398942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399043 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399137 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399137 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399364 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399442 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399442 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399609 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399680 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399938 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.399938 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.403403 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.403489 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.403630 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.403720 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.403805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.403905 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404016 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404016 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404189 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404385 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404479 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404657 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.404912 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.405071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.405071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.405336 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.405522 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.405630 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.405630 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.405798 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.405885 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.405969 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406062 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406156 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406417 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406510 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406611 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406706 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406801 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406900 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.406975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.407068 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.407366 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.407483 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.407581 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.407678 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.407775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.407856 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.407936 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.408183 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.408273 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.408443 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.408534 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.408628 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.408715 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.408814 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.408891 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.408989 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409086 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409459 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409541 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409614 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409691 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409776 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.409968 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410051 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410195 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410265 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410344 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410636 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410715 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410796 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410796 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.410941 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411017 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411017 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411154 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411246 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411329 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411402 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411402 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411534 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411620 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411779 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411857 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411929 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.411929 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.412101 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.412354 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.412447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.412617 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.413273 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.413381 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.413471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.413544 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.413615 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.413691 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.413762 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.413847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.413926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414004 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414309 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414388 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414460 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414529 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414598 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414749 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.414963 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415035 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415117 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415266 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415556 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415696 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415783 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415856 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415925 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415925 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.415925 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416277 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416349 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416426 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416503 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416662 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.416941 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417014 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417083 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417160 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417231 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417308 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417408 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417565 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417642 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417784 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417872 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.417945 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418015 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418092 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418165 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418503 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418582 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418662 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.418944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419088 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419177 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419270 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419364 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419459 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419744 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419830 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419909 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419909 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419909 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419909 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.419909 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.420338 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.420411 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.420480 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.420559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.420638 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.420709 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.420709 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.420846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.420928 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421085 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421163 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421163 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421295 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421380 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421460 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421539 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421694 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421765 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.421927 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.422004 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.422081 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.422152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.422222 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.422584 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.422697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.422785 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.422878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.422878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423221 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423313 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423399 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423483 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423671 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423813 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.423916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424062 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424148 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424245 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424339 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424425 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424518 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424603 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424603 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424769 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.424926 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.425025 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.425245 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.425359 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.425569 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.425693 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.425884 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.426017 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.426248 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.426528 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.426670 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.426837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.426960 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.427181 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.427485 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.427591 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.427884 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.428029 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.428205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.428315 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.428525 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.428639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.428838 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.428935 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.429156 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.429260 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.429472 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.429578 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.429786 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.429893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.430145 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.430246 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.430464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.430576 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.430799 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.430947 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.431115 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.431231 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.431426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.431533 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.431733 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.431835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.432072 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.432184 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.432386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.432497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.432703 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.432848 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.433006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.433108 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.433320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.433435 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.433640 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.433737 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.433952 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.434057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.434267 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.434565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.434676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.434882 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.434991 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.435192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.435310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.435508 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.435596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.435829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.436052 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.436205 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.436318 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.436516 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.436654 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.436841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.437070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.437219 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.437319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.437496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.437593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.437840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.437924 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.438164 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.438259 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.438487 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.438589 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.438815 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.438917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.439142 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.439246 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.439470 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.439699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.439802 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.440061 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.440174 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.440391 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.440551 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.440734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.440885 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.441073 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.441209 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.441387 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.441536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.441698 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.441862 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.442203 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.442312 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.442388 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.442643 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.442744 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.442962 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.443069 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.443275 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.443392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.443663 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.444018 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.444132 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.444287 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.444559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.444643 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.444924 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.445006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.445249 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.445334 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.445567 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.445649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.445888 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.445978 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.446206 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.446290 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.446526 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.446610 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.446844 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.447111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.447215 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.447292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.447474 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.447586 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.447821 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.447917 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.448171 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.448269 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.448502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.448596 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.448825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.448921 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.449148 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.449310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.449466 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.449686 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.449784 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.450007 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.450108 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.450335 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.450433 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.450661 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.450765 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.450988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.451082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.451310 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.451411 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.451620 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.451729 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.451940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.452089 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.452289 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.452396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.452609 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.452706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.452946 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.453086 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.453255 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.453354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.453579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.453676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.453919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.454088 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.454260 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.454357 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.454588 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.454885 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.454994 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.455213 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.455317 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.455540 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.455670 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.455927 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.456078 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.456223 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.456443 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.456550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.456769 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.456865 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.457114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.457210 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.457425 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.457548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.457752 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.457868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.458066 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.458169 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.458383 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.458484 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.458691 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.458789 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.459006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.459133 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.459313 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.459977 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.460309 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.460403 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.460639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.460799 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.460992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.461140 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.461309 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.461480 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.461620 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.461805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.461916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.462121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.462218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.462458 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.462552 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.462778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.462882 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.463108 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.463327 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.463430 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.463687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.463796 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.464060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.464218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.464356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.464458 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.464662 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.464769 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.464969 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.465065 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.465310 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.465630 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.465728 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.465963 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.466076 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.466285 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.466390 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.466601 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.466708 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.466930 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.467026 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.467247 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.467351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.467584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.467830 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.468249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.468433 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.468541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.468638 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.468726 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.468872 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.468872 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.469029 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.469186 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.469326 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.469499 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.469603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.469813 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.469906 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.470129 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.470227 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.470444 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.470548 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.470757 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.470870 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.471076 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.471173 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.471392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.471496 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.471709 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.471906 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.472078 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.472252 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.472406 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.472575 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.472734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.472901 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.473057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.473217 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.473374 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.473539 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.473708 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.473855 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.474025 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.474180 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.474383 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.474494 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.474655 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.474798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.475103 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.475724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.475941 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.476097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.476369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.476464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.476681 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.476788 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.476997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.477101 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.477322 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.477417 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.477647 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.477753 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.477981 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.478075 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.478317 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.478498 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.478724 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.478858 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.479021 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.479187 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.479290 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.479615 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.479755 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.479936 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.480216 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.480324 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.480555 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.480650 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.480906 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.481007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.481253 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.481348 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.481564 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.481667 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.481818 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=135704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:57:58.481914 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.482185 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.482527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.482852 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.483176 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.483497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.483821 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.484172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.484559 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.484896 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.485359 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.485589 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.485911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.486233 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.486564 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.486887 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.487212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.487540 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.487889 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.488246 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.488576 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.488901 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.489235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.489584 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.489903 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.490224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.490585 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.491265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.491859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.492291 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.492535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.492979 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.496847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.496847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.496847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.496847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.496847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.496847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.496847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.496847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.497485 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.497485 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.497485 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.497485 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.497774 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.497886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.498204 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.498521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.498848 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.499176 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.499501 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.499817 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.500153 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.500475 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.500792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.501107 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.501422 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.501815 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.502057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.502434 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.502779 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.503097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.503414 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.503732 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.504064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.504386 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.504701 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.505009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.505319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.505635 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.505949 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.506333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.506688 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.507000 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.507337 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.507658 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.508055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.508360 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.508682 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.509015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.509347 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.509670 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.510011 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.510432 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.510763 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.511088 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.511409 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.511733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.512077 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.512426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.512764 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.513081 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.513416 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.513750 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.514077 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.514407 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.514815 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.515074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.515395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.515715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.516056 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.516380 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.516696 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.517097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.517496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.517824 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.518153 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.518474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.518812 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.519149 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.519471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.519810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.520168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.520534 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.520860 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.521218 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.521557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.522414 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.522743 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.523144 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:57:58.523407 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=135703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:57:58.544277 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO dbcounter [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Registered counter for database nova_api Jul 28 03:57:58.566751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_db.sqlalchemy.engines [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:57:58.574572 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writer thread running {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:57:58.586565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO dbcounter [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Registered counter for database nova_api Jul 28 03:57:58.608514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_db.sqlalchemy.engines [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:57:58.616810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writer thread running {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:57:58.632371 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.context [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e515933-bed8-4837-a392-d3420c11c3a0(cell1) {{(pid=135704) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:57:58.636529 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:58.638111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:58.638919 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:58.640983 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:58.642969 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO dbcounter [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Registered counter for database nova_cell0 Jul 28 03:57:58.647224 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO dbcounter [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Registered counter for database nova_cell1 Jul 28 03:57:58.654693 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_db.sqlalchemy.engines [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:57:58.656504 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_db.sqlalchemy.engines [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:57:58.662107 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writer thread running {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:57:58.668206 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writer thread running {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:57:58.672867 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.context [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e515933-bed8-4837-a392-d3420c11c3a0(cell1) {{(pid=135703) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:57:58.677075 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:58.679426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:58.680337 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:58.682396 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:58.684467 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO dbcounter [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Registered counter for database nova_cell0 Jul 28 03:57:58.688716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO dbcounter [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Registered counter for database nova_cell1 Jul 28 03:57:58.699518 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_db.sqlalchemy.engines [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:57:58.704417 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_db.sqlalchemy.engines [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:57:58.707144 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writer thread running {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:57:58.817569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO dbcounter [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Registered counter for database nova_cell0 Jul 28 03:57:58.827225 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_db.sqlalchemy.engines [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:57:58.832789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writer thread running {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:57:58.852605 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writer thread running {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:57:58.862585 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO dbcounter [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Registered counter for database nova_cell0 Jul 28 03:57:58.870947 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_db.sqlalchemy.engines [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:57:58.875700 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writer thread running {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:57:59.157943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: WARNING keystonemiddleware.auth_token [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:57:59.166055 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: WARNING keystonemiddleware.auth_token [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:57:59.196294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: WARNING keystonemiddleware.auth_token [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:57:59.203690 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: WARNING keystonemiddleware.auth_token [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:57:59.514504 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: WARNING keystonemiddleware.auth_token [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:57:59.520704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: WARNING keystonemiddleware.auth_token [None req-74f6c1b2-ce1c-4831-98e8-847a85cff6e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:57:59.526638 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aeca8d29c0 pid: 135704 (default app) Jul 28 03:57:59.548907 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: WARNING keystonemiddleware.auth_token [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:57:59.555734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: WARNING keystonemiddleware.auth_token [None req-a2846ba8-efb7-4d10-a0a0-c2c5ace13cf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:57:59.561122 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aeca8d29c0 pid: 135703 (default app) Jul 28 03:58:41.769431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:41.771553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:41.772573 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:41.773685 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:43.094142 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-78ed4d5f-b4bd-4639-aa36-f874cbac3a90 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] Action: 'create', calling method: .version_select at 0x7f5578eefca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1842358131", "metadata": {"Type": "work"}}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:45.734590 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-78ed4d5f-b4bd-4639-aa36-f874cbac3a90 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.820376 Jul 28 03:58:45.734590 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Jul 28 03:58:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3824 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 28 03:58:45.737445 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:45.737445 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:45.737445 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:45.737445 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:45.992919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-15a8cd9d-623b-4594-917e-79c93b9b9f4d tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] Calling method '.version_select at 0x7f5578ece940>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:46.604050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-15a8cd9d-623b-4594-917e-79c93b9b9f4d tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed" status: 200 len: 353 microversion: 2.1 time: 1.020430 Jul 28 03:58:46.604727 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 1/2] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 03:58:45 2022] GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed => generated 353 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:58:47.626050 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-fd592a75-cdf8-4c14-b23f-9e9bf9622221 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] Calling method '.version_select at 0x7f5578d59af0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:47.725447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-fd592a75-cdf8-4c14-b23f-9e9bf9622221 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed" status: 200 len: 354 microversion: 2.1 time: 0.111097 Jul 28 03:58:47.726681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 03:58:47 2022] GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:47.739492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3fdd8997-65b6-47dd-b107-7680f5324f4e tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] Calling method '.version_select at 0x7f5578d93d30>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:47.828573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3fdd8997-65b6-47dd-b107-7680f5324f4e tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed" status: 200 len: 354 microversion: 2.1 time: 0.084087 Jul 28 03:58:47.828573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 03:58:47 2022] GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:47.835031 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ded52c40-39d2-46ef-a3f2-b7cddef8db64 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] Calling method '.version_select at 0x7f5578d6b1f0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:48.128424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ded52c40-39d2-46ef-a3f2-b7cddef8db64 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed" status: 202 len: 0 microversion: 2.1 time: 0.297705 Jul 28 03:58:48.129585 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 3/5] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 03:58:47 2022] DELETE /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:58:48.137785 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c23b569b-99be-49f2-a0bb-d898df932843 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] Calling method '.version_select at 0x7f5578d50160>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:48.248720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c23b569b-99be-49f2-a0bb-d898df932843 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed" status: 200 len: 353 microversion: 2.1 time: 0.114423 Jul 28 03:58:48.256236 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 3/6] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 03:58:48 2022] GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:49.262772 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9ac0cbc7-4370-49fc-9f07-4e76b0389472 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] Calling method '.version_select at 0x7f5578d6b8b0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:49.494218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-9ac0cbc7-4370-49fc-9f07-4e76b0389472 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] HTTP exception thrown: Volume 340a4321-7b76-4f97-9033-960bbe933bed could not be found. Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9ac0cbc7-4370-49fc-9f07-4e76b0389472 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] Request method failure captured: Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed HTTP/1.1 Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4glxEb2Jf2DSv1Z4pm6MApIWhXPg0f38EXcYqnoAzT4_majLtt_iDBaYHbVkJQppOLdX1UR5KUgnryB-gilJdM8V-_2fkRHs0geKsTxceO0_F1WlUgQGYX1SOClHrYNqxgDQMprNHMCX_OmG82QoK2zZJPQQCECqIdoTZJS7bBEG9BM Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 403621ebcb9243ba844ab169041bb142 Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-VolumesGetTestJSON-68435079 Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 03:58:49.505673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_403621ebcb9243ba844ab169041bb142", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/403621ebcb9243ba844ab169041bb142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/403621ebcb9243ba844ab169041bb142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/403621ebcb9243ba844ab169041bb142"}]}] Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-VolumesGetTestJSON-68435079 Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 403621ebcb9243ba844ab169041bb142 Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-VolumesGetTestJSON-68435079 Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-VolumesGetTestJSON-68435079-project Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: df4d902a6da14199a858c76f07556bc4 Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-VolumesGetTestJSON-68435079-project Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Volume 340a4321-7b76-4f97-9033-960bbe933bed could not be found. Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '340a4321-7b76-4f97-9033-960bbe933bed'} Jul 28 03:58:49.506917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 340a4321-7b76-4f97-9033-960bbe933bed could not be found. (HTTP 404) (Request-ID: req-e7b9e46a-e58c-4871-94d6-f3bd885d397c) Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:49.507734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:58:49.508860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 340a4321-7b76-4f97-9033-960bbe933bed could not be found. Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 03:58:49.513316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 340a4321-7b76-4f97-9033-960bbe933bed could not be found. Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 340a4321-7b76-4f97-9033-960bbe933bed could not be found. Jul 28 03:58:49.514574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.517199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9ac0cbc7-4370-49fc-9f07-4e76b0389472 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] Returning 404 to user: Volume 340a4321-7b76-4f97-9033-960bbe933bed could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:49.519367 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9ac0cbc7-4370-49fc-9f07-4e76b0389472 tempest-VolumesGetTestJSON-68435079 tempest-VolumesGetTestJSON-68435079-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed" status: 404 len: 109 microversion: 2.1 time: 0.260372 Jul 28 03:58:49.527460 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 03:58:49 2022] GET /compute/v2.1/os-volumes/340a4321-7b76-4f97-9033-960bbe933bed => generated 109 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:55.449620 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fb0d8127-6d01-4c97-a16d-5a18add8acf6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Action: 'create', calling method: .version_select at 0x7f5578d93ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-678214442", "metadata": {"Type": "work"}}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fb0d8127-6d01-4c97-a16d-5a18add8acf6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Request method failure captured: Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 121 Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gl-aCWNZ7RRDZpJKP2W_OvkIA1cod3VWto5i5cz-5GmeZVewEOwPlM4EC7xDSmFa8wUMXtQBuNDRYusHN4BNgpZ05XTDdHg6lgZDVQobozr25AxdilS6quqZsM6XVT0dX_4c8gwOdodhkA2R5RR4bIyFQCGXZsIqgHeXou1UOb-pnE Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 03:58:55.462406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a2db815aaec84580b6868dac3b98d9c8", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}] Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 113ded91b70f4c20a84464ed0a5a897e Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-678214442", "metadata": {"Type": "work"}}} Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: Jul 28 03:58:55.463418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-678214442', 'metadata': {'Type': 'work'}}}} Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:55.464074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:58:55.465057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:58:55.465927 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 03:58:55.465927 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.465927 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fb0d8127-6d01-4c97-a16d-5a18add8acf6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:55.466178 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fb0d8127-6d01-4c97-a16d-5a18add8acf6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.536155 Jul 28 03:58:55.468267 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 4/8] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Jul 28 03:58:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 539 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:58:55.477941 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-150d945d-44f5-4a59-b2de-d430b34919ce tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Action: 'create', calling method: .version_select at 0x7f5578cd7280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-766676148", "metadata": {"Type": "work"}}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-150d945d-44f5-4a59-b2de-d430b34919ce tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Request method failure captured: Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 119 Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gl-aCWNZ7RRDZpJKP2W_OvkIA1cod3VWto5i5cz-5GmeZVewEOwPlM4EC7xDSmFa8wUMXtQBuNDRYusHN4BNgpZ05XTDdHg6lgZDVQobozr25AxdilS6quqZsM6XVT0dX_4c8gwOdodhkA2R5RR4bIyFQCGXZsIqgHeXou1UOb-pnE Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 03:58:55.499622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a2db815aaec84580b6868dac3b98d9c8", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}] Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 113ded91b70f4c20a84464ed0a5a897e Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-766676148", "metadata": {"Type": "work"}}} Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: Jul 28 03:58:55.500800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-766676148', 'metadata': {'Type': 'work'}}}} Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi '0' Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:55.501402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:58:55.502357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:58:55.503175 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 03:58:55.503175 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.507581 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-150d945d-44f5-4a59-b2de-d430b34919ce tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:55.511775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-150d945d-44f5-4a59-b2de-d430b34919ce tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.039367 Jul 28 03:58:55.514741 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 5/9] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Jul 28 03:58:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:58:55.528204 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7d240e29-62d5-4f90-b78c-1df40bf472cb tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Action: 'create', calling method: .version_select at 0x7f5578cd7d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1024232595", "metadata": {"Type": "work"}}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7d240e29-62d5-4f90-b78c-1df40bf472cb tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Request method failure captured: Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 119 Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gl-aCWNZ7RRDZpJKP2W_OvkIA1cod3VWto5i5cz-5GmeZVewEOwPlM4EC7xDSmFa8wUMXtQBuNDRYusHN4BNgpZ05XTDdHg6lgZDVQobozr25AxdilS6quqZsM6XVT0dX_4c8gwOdodhkA2R5RR4bIyFQCGXZsIqgHeXou1UOb-pnE Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 03:58:55.543825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a2db815aaec84580b6868dac3b98d9c8", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}] Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 113ded91b70f4c20a84464ed0a5a897e Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1024232595", "metadata": {"Type": "work"}}} Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: Jul 28 03:58:55.545007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1024232595', 'metadata': {'Type': 'work'}}}} Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi '' Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:55.545603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:58:55.546544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:58:55.547432 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 03:58:55.547432 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.549215 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7d240e29-62d5-4f90-b78c-1df40bf472cb tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:55.550482 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7d240e29-62d5-4f90-b78c-1df40bf472cb tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026249 Jul 28 03:58:55.552943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 6/10] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Jul 28 03:58:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:58:55.562824 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d903433c-773a-42d3-9de3-55d6bb68e0d6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Calling method '.version_select at 0x7f5578d6b0d0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:55.628248 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-d903433c-773a-42d3-9de3-55d6bb68e0d6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] HTTP exception thrown: Volume tempest-invalid-1164048486 could not be found. Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d903433c-773a-42d3-9de3-55d6bb68e0d6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Request method failure captured: Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1164048486 HTTP/1.1 Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gl-aCWNZ7RRDZpJKP2W_OvkIA1cod3VWto5i5cz-5GmeZVewEOwPlM4EC7xDSmFa8wUMXtQBuNDRYusHN4BNgpZ05XTDdHg6lgZDVQobozr25AxdilS6quqZsM6XVT0dX_4c8gwOdodhkA2R5RR4bIyFQCGXZsIqgHeXou1UOb-pnE Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 03:58:55.631234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a2db815aaec84580b6868dac3b98d9c8", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}] Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 113ded91b70f4c20a84464ed0a5a897e Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Volume tempest-invalid-1164048486 could not be found. Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': 'tempest-invalid-1164048486'} Jul 28 03:58:55.632452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1164048486 could not be found. (HTTP 404) (Request-ID: req-18d79591-f5f5-4e50-a273-48f5e7304533) Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.633057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:58:55.633997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1164048486 could not be found. Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:55.634830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1164048486 could not be found. Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1164048486 could not be found. Jul 28 03:58:55.635729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.638131 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d903433c-773a-42d3-9de3-55d6bb68e0d6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Returning 404 to user: Volume tempest-invalid-1164048486 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:55.639368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d903433c-773a-42d3-9de3-55d6bb68e0d6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1164048486" status: 404 len: 99 microversion: 2.1 time: 0.080880 Jul 28 03:58:55.640420 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 7/11] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Jul 28 03:58:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1164048486 => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:58:55.650784 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-dcaa2ca4-aec0-4154-8f80-ee4598365cc6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005171 Jul 28 03:58:55.655104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 8/12] 10.222.0.66 () {58 vars in 1140 bytes} [Thu Jul 28 03:58:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 03:58:55.672122 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fea972ad-4ffb-47af-9c41-778a33624b73 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'create', calling method: .version_select at 0x7f5578d57670>, body: {"keypair": {"name": "tempest-keypair-1670813683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEld+/5krET3O34C8rQu/bAwsDOy+kODEWrW45XR7PNSgwvF7p1S+/hSidFQNz8LM46jHKl23FzmCDPRsgz6z8YpLbte9OCtNEao64UsTB2A7MuS8GIZBUFWBtChXHQZgA=="}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:55.681759 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a3580222-3edd-447a-947d-f61d76db9b62 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006321 Jul 28 03:58:55.683004 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 9/13] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Jul 28 03:58:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 03:58:55.691850 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8524d8f9-921b-4cdb-bfde-5da63c21e806 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Calling method '.version_select at 0x7f5578cd7af0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:55.751634 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-8524d8f9-921b-4cdb-bfde-5da63c21e806 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] HTTP exception thrown: Volume 85400efa-d251-4d29-b435-3a616e014f47 could not be found. Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8524d8f9-921b-4cdb-bfde-5da63c21e806 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Request method failure captured: Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/os-volumes/85400efa-d251-4d29-b435-3a616e014f47 HTTP/1.1 Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gl-aCWNZ7RRDZpJKP2W_OvkIA1cod3VWto5i5cz-5GmeZVewEOwPlM4EC7xDSmFa8wUMXtQBuNDRYusHN4BNgpZ05XTDdHg6lgZDVQobozr25AxdilS6quqZsM6XVT0dX_4c8gwOdodhkA2R5RR4bIyFQCGXZsIqgHeXou1UOb-pnE Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 03:58:55.753829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a2db815aaec84580b6868dac3b98d9c8", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}] Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 113ded91b70f4c20a84464ed0a5a897e Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Volume 85400efa-d251-4d29-b435-3a616e014f47 could not be found. Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '85400efa-d251-4d29-b435-3a616e014f47'} Jul 28 03:58:55.754845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85400efa-d251-4d29-b435-3a616e014f47 could not be found. (HTTP 404) (Request-ID: req-c3d3a467-d43d-4ab3-952c-c08d91f4f0d7) Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.756124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:58:55.757034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85400efa-d251-4d29-b435-3a616e014f47 could not be found. Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 03:58:55.757863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85400efa-d251-4d29-b435-3a616e014f47 could not be found. Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85400efa-d251-4d29-b435-3a616e014f47 could not be found. Jul 28 03:58:55.760676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.762928 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8524d8f9-921b-4cdb-bfde-5da63c21e806 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Returning 404 to user: Volume 85400efa-d251-4d29-b435-3a616e014f47 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:55.764069 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8524d8f9-921b-4cdb-bfde-5da63c21e806 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/85400efa-d251-4d29-b435-3a616e014f47" status: 404 len: 109 microversion: 2.1 time: 0.075953 Jul 28 03:58:55.765158 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 10/14] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 03:58:55 2022] DELETE /compute/v2.1/os-volumes/85400efa-d251-4d29-b435-3a616e014f47 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:55.775513 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d5a11c24-c9bd-4d34-95d9-c91512d0f1b6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Calling method '.version_select at 0x7f5578cd7310>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:55.849681 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-fea972ad-4ffb-47af-9c41-778a33624b73 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Getting quotas for project 6a869e1e00fc4d8d9d4511e34501665f. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:58:55.850211 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-d5a11c24-c9bd-4d34-95d9-c91512d0f1b6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] HTTP exception thrown: Volume e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e could not be found. Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d5a11c24-c9bd-4d34-95d9-c91512d0f1b6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Request method failure captured: Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/os-volumes/e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e HTTP/1.1 Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gl-aCWNZ7RRDZpJKP2W_OvkIA1cod3VWto5i5cz-5GmeZVewEOwPlM4EC7xDSmFa8wUMXtQBuNDRYusHN4BNgpZ05XTDdHg6lgZDVQobozr25AxdilS6quqZsM6XVT0dX_4c8gwOdodhkA2R5RR4bIyFQCGXZsIqgHeXou1UOb-pnE Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 03:58:55.853037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a2db815aaec84580b6868dac3b98d9c8", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a2db815aaec84580b6868dac3b98d9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a2db815aaec84580b6868dac3b98d9c8"}]}] Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: a2db815aaec84580b6868dac3b98d9c8 Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-VolumesNegativeTest-968259742 Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 113ded91b70f4c20a84464ed0a5a897e Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-VolumesNegativeTest-968259742-project Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Volume e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e could not be found. Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': 'e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e'} Jul 28 03:58:55.854056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e could not be found. (HTTP 404) (Request-ID: req-08182aa2-4d46-4dae-b90b-1daa4874177a) Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.854653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:58:55.855490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e could not be found. Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 03:58:55.856354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e could not be found. Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e could not be found. Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d5a11c24-c9bd-4d34-95d9-c91512d0f1b6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] Returning 404 to user: Volume e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:55.857199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d5a11c24-c9bd-4d34-95d9-c91512d0f1b6 tempest-VolumesNegativeTest-968259742 tempest-VolumesNegativeTest-968259742-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e" status: 404 len: 109 microversion: 2.1 time: 0.084239 Jul 28 03:58:55.866205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 11/15] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 03:58:55 2022] GET /compute/v2.1/os-volumes/e2cf1e73-37fe-4c92-9b82-2f1da2c91e7e => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:58:55.876228 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-fea972ad-4ffb-47af-9c41-778a33624b73 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Getting quotas for user f301573dbb914d7a948851cb060d8483 and project 6a869e1e00fc4d8d9d4511e34501665f. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:58:56.061263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fea972ad-4ffb-47af-9c41-778a33624b73 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.564111 Jul 28 03:58:56.075401 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 5/16] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 03:58:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:02.580582 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-81eb94af-f58b-404a-bae1-b75720b3dee6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'create', calling method: .version_select at 0x7f5578cd7a60>, body: {"keypair": {"name": "tempest-keypair-1586234179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkbrAV+rSQFXU1NYpvWX9d+2C773MHLtjhN580oTaWlf5ySzAmca6ML9WCumHD9VVuMUqr2B4pc0x35Tq+ll2EA7HzXuA557CTTKZTonjVBetYYGgi/8orkrU9kpgfjwQ=="}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:02.683400 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-81eb94af-f58b-404a-bae1-b75720b3dee6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Getting quotas for project 52b087e8dc5c4426b8402dfdf99328ad. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:02.695706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-81eb94af-f58b-404a-bae1-b75720b3dee6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Getting quotas for user cf3333bf3bc149139f9f6b4e89d2e89b and project 52b087e8dc5c4426b8402dfdf99328ad. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:02.887855 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-81eb94af-f58b-404a-bae1-b75720b3dee6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.884006 Jul 28 03:59:02.888541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 12/17] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Jul 28 03:59:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 886 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:59:02.946639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1553486459", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "networks": [{"uuid": "1b695295-a70d-4773-a7f6-af5ea3f070dd"}]}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:03.064479 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-afa2187d-ef22-4823-b0e8-56740382091b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: .version_select at 0x7f5578c57430>, body: {"keypair": {"name": "tempest-keypair-908294098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjcSZEMppy+gkQai2uSittx8WlxrPg1ee5ODce3zvGykXzhq8yJzTq4Mtj/n3IAkioIVDlxst7fXoFzGpwcX8/2YJJgn4Zs25gfrjHn3Tj8jWTRZPKOJf4oqnsVSLWEGQ=="}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:03.092003 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-afa2187d-ef22-4823-b0e8-56740382091b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for project f68fb083db524ab59ba49d71ae754ba0. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:03.097243 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-afa2187d-ef22-4823-b0e8-56740382091b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for user 37b7380889a4411cb57465ab5d33ba75 and project f68fb083db524ab59ba49d71ae754ba0. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:03.167723 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] validate_networks() for [('1b695295-a70d-4773-a7f6-af5ea3f070dd', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:03.267839 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-afa2187d-ef22-4823-b0e8-56740382091b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.368359 Jul 28 03:59:03.268861 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 13/18] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 03:59:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:03.276858 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1394047512", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b7076b1-5b54-41f8-8740-25deddb61b0a"}], "security_groups": [{"name": "tempest-securitygroup--1214731654"}], "key_name": "tempest-keypair-1670813683", "user_data": "}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:03.666243 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.network.neutron [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] validate_networks() for [('5b7076b1-5b54-41f8-8740-25deddb61b0a', None, None, None, None, None)] {{(pid=135704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:05.892292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=4 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:06.299635 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:06.300463 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:06.303242 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:06.303242 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:06.303242 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:06.321819 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:06.322779 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:06.323980 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:06.324888 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:06.374456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Getting quotas for project 5c3d84518f1e4d7885f6998c88c3da4a. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:06.383592 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Getting quotas for user 35d4c725ac09419db89121b72da41eec and project 5c3d84518f1e4d7885f6998c88c3da4a. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:06.409330 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:06.414857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:06.588930 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Flavor limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:06.589377 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Image limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:06.589850 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Flavor pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:06.590273 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Image pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:06.590694 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:06.607996 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:06.608697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:06.609664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:06.613857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-252926b8-e6bb-42d8-b958-cbcd20e1b4ef tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.870370 Jul 28 03:59:06.619310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 6/19] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:06.630063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-142cb33c-6409-4359-a4cb-98d966f78286 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:06.634456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-142cb33c-6409-4359-a4cb-98d966f78286 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:06.635104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:06.710934 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Getting quotas for project 6a869e1e00fc4d8d9d4511e34501665f. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:06.736813 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Getting quotas for user f301573dbb914d7a948851cb060d8483 and project 6a869e1e00fc4d8d9d4511e34501665f. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:06.768105 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Going to run 1 instances... {{(pid=135704) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:06.772625 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:06.932184 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-142cb33c-6409-4359-a4cb-98d966f78286 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:06.957746 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-142cb33c-6409-4359-a4cb-98d966f78286 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1215 microversion: 2.1 time: 0.330610 Jul 28 03:59:06.959629 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 7/20] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:06 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1215 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:07.046061 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1b92f6ad-94a7-4ca7-8300-0eed43559d63 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.775748 Jul 28 03:59:07.048096 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 14/21] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 3778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:07.060868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a98d527c-73f7-43b6-af5d-7363930b267e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:07.060868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a98d527c-73f7-43b6-af5d-7363930b267e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:07.238589 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a98d527c-73f7-43b6-af5d-7363930b267e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:07.247244 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a98d527c-73f7-43b6-af5d-7363930b267e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1238 microversion: 2.1 time: 0.191749 Jul 28 03:59:07.293552 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 8/22] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:07 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1238 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:07.521863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-589666958", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:07.667012 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.network.neutron [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] validate_networks() for [('4531d3b7-3c72-4c16-9fba-50470f633af2', None, None, None, None, None)] {{(pid=135704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:07.987393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3148b572-bee4-4933-b70a-5082fa76be43 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:07.988803 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3148b572-bee4-4933-b70a-5082fa76be43 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:08.145613 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3148b572-bee4-4933-b70a-5082fa76be43 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:08.160594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3148b572-bee4-4933-b70a-5082fa76be43 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1215 microversion: 2.1 time: 0.177461 Jul 28 03:59:08.172377 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 9/23] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:07 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:08.304105 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4e703ef4-8c7c-4d68-8322-55c71c24df8e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:08.304799 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4e703ef4-8c7c-4d68-8322-55c71c24df8e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:08.435175 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4e703ef4-8c7c-4d68-8322-55c71c24df8e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:08.442740 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4e703ef4-8c7c-4d68-8322-55c71c24df8e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1238 microversion: 2.1 time: 0.145290 Jul 28 03:59:08.447572 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 10/24] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:08 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1238 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:08.942709 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Flavor limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:08.943841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Image limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:08.944219 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Flavor pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:08.944732 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Image pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:08.945159 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:08.956245 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:08.957058 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:08.957999 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:08.958568 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:08.981823 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Getting quotas for project 8bf7f0f7880a435ba552361bcb31ef91. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:08.993030 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Getting quotas for user 4251e84650f047c9a6eb0c3b16b25564 and project 8bf7f0f7880a435ba552361bcb31ef91. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:09.024429 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Going to run 1 instances... {{(pid=135704) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:09.029502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:09.184296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2b23df8e-0d65-44ee-b02a-5535d1be02d0 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:09.184931 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2b23df8e-0d65-44ee-b02a-5535d1be02d0 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:09.278605 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f14348ff-c0e6-4cd6-a0ed-50f25ab3b587 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.136759 Jul 28 03:59:09.279646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 15/25] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:59:09.291529 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-25f6216a-fa11-4903-8b33-a2657c75a6f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:09.292020 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-25f6216a-fa11-4903-8b33-a2657c75a6f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:09.753612 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-25f6216a-fa11-4903-8b33-a2657c75a6f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:09.795165 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-25f6216a-fa11-4903-8b33-a2657c75a6f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1221 microversion: 2.1 time: 0.506901 Jul 28 03:59:09.797751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 16/26] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:09 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1221 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:09.812941 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-cfd1ff2d-4547-4a5a-882b-94dede8f45fe tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:09.813814 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-cfd1ff2d-4547-4a5a-882b-94dede8f45fe tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:09.826655 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2b23df8e-0d65-44ee-b02a-5535d1be02d0 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:09.846760 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2b23df8e-0d65-44ee-b02a-5535d1be02d0 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1215 microversion: 2.1 time: 0.665492 Jul 28 03:59:09.872499 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 11/27] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:09 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1215 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:09.998455 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cfd1ff2d-4547-4a5a-882b-94dede8f45fe tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:10.016139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-cfd1ff2d-4547-4a5a-882b-94dede8f45fe tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1238 microversion: 2.1 time: 0.216871 Jul 28 03:59:10.030090 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 17/28] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:09 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1238 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:10.200651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1361479502", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:10.222685 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1269508817", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "500d2409-0505-4e71-ad33-d33fa2f8a8dc"}], "security_groups": [{"name": "tempest-securitygroup--1066177266"}], "key_name": "tempest-keypair-1586234179", "user_data": "}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:10.310208 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] validate_networks() for [('4531d3b7-3c72-4c16-9fba-50470f633af2', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:10.955036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.network.neutron [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] validate_networks() for [('500d2409-0505-4e71-ad33-d33fa2f8a8dc', None, None, None, None, None)] {{(pid=135704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:12.156454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:12.157005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:12.157801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:12.158409 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:12.159445 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:12.171631 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.172293 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.186371 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.187167 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.214710 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Flavor limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:12.215141 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Image limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:12.215681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Flavor pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:12.216147 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Image pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:12.216633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:12.231911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Getting quotas for project 8bf7f0f7880a435ba552361bcb31ef91. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:12.239568 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Getting quotas for user 4251e84650f047c9a6eb0c3b16b25564 and project 8bf7f0f7880a435ba552361bcb31ef91. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:12.242360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.243076 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.249222 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.250327 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.295466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:12.302886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:12.362376 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Getting quotas for project 52b087e8dc5c4426b8402dfdf99328ad. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:12.378151 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Getting quotas for user cf3333bf3bc149139f9f6b4e89d2e89b and project 52b087e8dc5c4426b8402dfdf99328ad. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:12.422762 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Going to run 1 instances... {{(pid=135704) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:12.428887 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:12.528503 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c3d07871-9041-4a54-aafb-704c2b45b9b4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.333539 Jul 28 03:59:12.535930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 12/29] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:12.573233 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-dd224248-894e-4896-af95-ee2404d89500 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:12.576037 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-dd224248-894e-4896-af95-ee2404d89500 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:12.604718 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dd224248-894e-4896-af95-ee2404d89500 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.606221 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dd224248-894e-4896-af95-ee2404d89500 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.609495 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dd224248-894e-4896-af95-ee2404d89500 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.612481 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dd224248-894e-4896-af95-ee2404d89500 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.679719 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4a832016-68c0-4728-a7c0-1a15b164df54 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.461344 Jul 28 03:59:12.692452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 18/30] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Jul 28 03:59:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2475 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:59:12.721668 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-82ad4157-c371-40ce-bfcf-68b791129294 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:12.721668 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-82ad4157-c371-40ce-bfcf-68b791129294 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:12.749229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-82ad4157-c371-40ce-bfcf-68b791129294 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.755658 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-82ad4157-c371-40ce-bfcf-68b791129294 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.758353 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-82ad4157-c371-40ce-bfcf-68b791129294 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.759023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-82ad4157-c371-40ce-bfcf-68b791129294 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:13.446334 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-dd224248-894e-4896-af95-ee2404d89500 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:13.468367 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-dd224248-894e-4896-af95-ee2404d89500 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1273 microversion: 2.1 time: 0.916944 Jul 28 03:59:13.468965 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 13/31] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:12 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1273 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:13.509834 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-90758696-6cc5-41bd-b371-969c8e6518e5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:13.509834 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-90758696-6cc5-41bd-b371-969c8e6518e5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:13.695016 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-90758696-6cc5-41bd-b371-969c8e6518e5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:13.707003 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-90758696-6cc5-41bd-b371-969c8e6518e5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1222 microversion: 2.1 time: 0.217740 Jul 28 03:59:13.707825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 14/32] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:13 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1222 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:13.732597 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f0228c6c-d6b9-44fb-88d5-b61ee93e0026 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:13.733755 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f0228c6c-d6b9-44fb-88d5-b61ee93e0026 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:14.058775 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f0228c6c-d6b9-44fb-88d5-b61ee93e0026 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:14.067940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f0228c6c-d6b9-44fb-88d5-b61ee93e0026 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:14.073998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f0228c6c-d6b9-44fb-88d5-b61ee93e0026 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:14.075161 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f0228c6c-d6b9-44fb-88d5-b61ee93e0026 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1282 microversion: 2.20 time: 0.366076 Jul 28 03:59:14.075733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 15/33] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:13 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1282 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:14.129612 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-569599802", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cf9021b-c509-4bfd-870b-1ff5c987c7dd"}], "security_groups": [{"name": "tempest-securitygroup--725959652"}], "key_name": "tempest-keypair-908294098", "user_data": "}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:14.441265 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-82ad4157-c371-40ce-bfcf-68b791129294 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:14.462851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-82ad4157-c371-40ce-bfcf-68b791129294 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1308 microversion: 2.1 time: 1.768238 Jul 28 03:59:14.468315 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 19/34] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:12 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1308 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:14.493824 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2d98137f-e2a3-4cf7-b648-ba15fb29c3e6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:14.495457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2d98137f-e2a3-4cf7-b648-ba15fb29c3e6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:14.508401 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d98137f-e2a3-4cf7-b648-ba15fb29c3e6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:14.510189 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d98137f-e2a3-4cf7-b648-ba15fb29c3e6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:14.512811 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d98137f-e2a3-4cf7-b648-ba15fb29c3e6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:14.516366 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d98137f-e2a3-4cf7-b648-ba15fb29c3e6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:14.835985 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2d98137f-e2a3-4cf7-b648-ba15fb29c3e6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:14.864556 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2d98137f-e2a3-4cf7-b648-ba15fb29c3e6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1273 microversion: 2.1 time: 0.375488 Jul 28 03:59:14.890967 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 20/35] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:14 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1273 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:14.908344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4a314c74-9e6c-4f5d-960f-e7465ce370a5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:14.908439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4a314c74-9e6c-4f5d-960f-e7465ce370a5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:14.934408 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a314c74-9e6c-4f5d-960f-e7465ce370a5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:14.943276 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a314c74-9e6c-4f5d-960f-e7465ce370a5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:14.944877 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a314c74-9e6c-4f5d-960f-e7465ce370a5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:14.945349 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a314c74-9e6c-4f5d-960f-e7465ce370a5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.446175 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4a314c74-9e6c-4f5d-960f-e7465ce370a5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:15.446175 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4a314c74-9e6c-4f5d-960f-e7465ce370a5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1226 microversion: 2.1 time: 0.416291 Jul 28 03:59:15.446175 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 21/36] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:14 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1226 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:15.446175 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:15.448272 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:15.448272 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.448272 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.448272 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.449122 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.455066 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:15.475360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:15.475360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:15.479715 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-bce3d03f-4412-4d84-a62e-ee30908a925e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1286 microversion: 2.20 time: 0.150662 Jul 28 03:59:15.496987 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 22/37] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:15 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:15.503229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-75b27dab-8c82-4d8b-86c1-3ddebce6aa02 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:15.503884 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-75b27dab-8c82-4d8b-86c1-3ddebce6aa02 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:15.520424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-75b27dab-8c82-4d8b-86c1-3ddebce6aa02 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.520424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-75b27dab-8c82-4d8b-86c1-3ddebce6aa02 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.520424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-75b27dab-8c82-4d8b-86c1-3ddebce6aa02 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.520424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-75b27dab-8c82-4d8b-86c1-3ddebce6aa02 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.738833 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-75b27dab-8c82-4d8b-86c1-3ddebce6aa02 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:15.752773 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-75b27dab-8c82-4d8b-86c1-3ddebce6aa02 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1296 microversion: 2.1 time: 0.254526 Jul 28 03:59:15.754197 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 23/38] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:15 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1296 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:15.882717 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] validate_networks() for [('9cf9021b-c509-4bfd-870b-1ff5c987c7dd', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:15.920739 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-db416590-2497-4fc2-abff-042626233ce6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:15.920739 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-db416590-2497-4fc2-abff-042626233ce6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:15.941969 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-db416590-2497-4fc2-abff-042626233ce6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.943695 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-db416590-2497-4fc2-abff-042626233ce6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.946313 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-db416590-2497-4fc2-abff-042626233ce6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.949898 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-db416590-2497-4fc2-abff-042626233ce6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:16.705271 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-db416590-2497-4fc2-abff-042626233ce6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:16.730062 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-db416590-2497-4fc2-abff-042626233ce6 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.838219 Jul 28 03:59:16.762018 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 24/39] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:15 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:16.794237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e1235104-6be2-4afd-8789-e4de5ec6374a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:16.800334 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e1235104-6be2-4afd-8789-e4de5ec6374a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:16.821218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e1235104-6be2-4afd-8789-e4de5ec6374a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:16.821730 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e1235104-6be2-4afd-8789-e4de5ec6374a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:16.822463 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e1235104-6be2-4afd-8789-e4de5ec6374a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:16.822911 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e1235104-6be2-4afd-8789-e4de5ec6374a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:17.415367 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e1235104-6be2-4afd-8789-e4de5ec6374a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:17.425151 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e1235104-6be2-4afd-8789-e4de5ec6374a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1282 microversion: 2.1 time: 0.660153 Jul 28 03:59:17.432659 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 25/40] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:16 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1282 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:17.452685 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:17.453458 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:17.481074 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:17.498306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:17.508909 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:17.512040 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:17.515395 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:18.167449 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:18.212220 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:18.226370 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:18.234178 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ade52a81-4c78-4f59-855a-563d7e3fb0f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1334 microversion: 2.20 time: 0.793163 Jul 28 03:59:18.235159 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 26/41] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:17 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1334 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:18.274460 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-bf3f7dc1-af19-44ab-9f89-5a78e6d0b29e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:18.278942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-bf3f7dc1-af19-44ab-9f89-5a78e6d0b29e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:18.316022 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf3f7dc1-af19-44ab-9f89-5a78e6d0b29e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:18.318431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf3f7dc1-af19-44ab-9f89-5a78e6d0b29e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:18.326199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf3f7dc1-af19-44ab-9f89-5a78e6d0b29e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:18.327626 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf3f7dc1-af19-44ab-9f89-5a78e6d0b29e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:19.211717 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:19.216331 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:19.221091 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:19.222636 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:19.228444 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:19.237248 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:19.259107 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:19.259578 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:19.264627 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:19.266326 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:19.326939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for project f68fb083db524ab59ba49d71ae754ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:19.346345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for user 37b7380889a4411cb57465ab5d33ba75 and project f68fb083db524ab59ba49d71ae754ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:19.386855 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:19.394507 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:19.869172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-519a6c3d-ab61-43b6-969c-8d7a6c7f7ef2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.711749 Jul 28 03:59:19.869172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 16/42] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 5746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:19.869172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6ed43dad-489f-4f36-a8ad-f6994c1db2a2 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:19.869172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6ed43dad-489f-4f36-a8ad-f6994c1db2a2 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:19.869172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6ed43dad-489f-4f36-a8ad-f6994c1db2a2 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:19.871081 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6ed43dad-489f-4f36-a8ad-f6994c1db2a2 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:19.871081 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6ed43dad-489f-4f36-a8ad-f6994c1db2a2 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:19.871081 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6ed43dad-489f-4f36-a8ad-f6994c1db2a2 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:20.183824 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bf3f7dc1-af19-44ab-9f89-5a78e6d0b29e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:20.202658 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-bf3f7dc1-af19-44ab-9f89-5a78e6d0b29e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 1.964579 Jul 28 03:59:20.203369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 27/43] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:18 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:20.211005 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c0e6a8ea-f5f5-4057-a38b-2b041ba3e005 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:20.211644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c0e6a8ea-f5f5-4057-a38b-2b041ba3e005 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:20.245828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c0e6a8ea-f5f5-4057-a38b-2b041ba3e005 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:20.246548 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c0e6a8ea-f5f5-4057-a38b-2b041ba3e005 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:20.261214 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c0e6a8ea-f5f5-4057-a38b-2b041ba3e005 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:20.262323 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c0e6a8ea-f5f5-4057-a38b-2b041ba3e005 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:20.664205 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6ed43dad-489f-4f36-a8ad-f6994c1db2a2 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:20.691090 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c0e6a8ea-f5f5-4057-a38b-2b041ba3e005 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:20.703648 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c0e6a8ea-f5f5-4057-a38b-2b041ba3e005 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1280 microversion: 2.1 time: 0.498418 Jul 28 03:59:20.704536 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 28/44] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:20 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1280 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:20.709501 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:20.710735 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6ed43dad-489f-4f36-a8ad-f6994c1db2a2 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.886482 Jul 28 03:59:20.716265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 17/45] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:19 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:20.730842 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9f20210a-6cbf-4642-8fab-64f701dab9d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:20.735829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9f20210a-6cbf-4642-8fab-64f701dab9d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:20.747673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:20.766001 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:20.767541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:20.774251 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:20.778389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:21.626213 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9f20210a-6cbf-4642-8fab-64f701dab9d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:21.644410 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9f20210a-6cbf-4642-8fab-64f701dab9d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1240 microversion: 2.1 time: 0.926576 Jul 28 03:59:21.647700 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 18/46] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:20 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1240 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:21.670302 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fdb08f47-f816-4945-8bc0-26e821857286 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:21.673714 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fdb08f47-f816-4945-8bc0-26e821857286 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:21.703924 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fdb08f47-f816-4945-8bc0-26e821857286 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:21.706359 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fdb08f47-f816-4945-8bc0-26e821857286 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:21.712299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fdb08f47-f816-4945-8bc0-26e821857286 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:21.713508 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fdb08f47-f816-4945-8bc0-26e821857286 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.041125 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:22.051161 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:22.056023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:22.060876 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8bf25db3-e06e-4bc4-9dd2-68700d73e5a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1340 microversion: 2.20 time: 1.355161 Jul 28 03:59:22.064718 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 29/47] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:20 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1340 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:22.074398 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-cc2926ac-3b9b-45d3-9ebd-aebba19780c1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:22.079676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-cc2926ac-3b9b-45d3-9ebd-aebba19780c1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:22.088321 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cc2926ac-3b9b-45d3-9ebd-aebba19780c1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:22.089380 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cc2926ac-3b9b-45d3-9ebd-aebba19780c1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.090885 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cc2926ac-3b9b-45d3-9ebd-aebba19780c1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:22.091493 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cc2926ac-3b9b-45d3-9ebd-aebba19780c1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.228773 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cc2926ac-3b9b-45d3-9ebd-aebba19780c1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:22.247312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-cc2926ac-3b9b-45d3-9ebd-aebba19780c1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1280 microversion: 2.1 time: 0.180051 Jul 28 03:59:22.256650 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 30/48] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:22 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:22.268843 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1d4997ab-c5c3-45f7-ba81-137c0c99a1d7 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:22.273332 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1d4997ab-c5c3-45f7-ba81-137c0c99a1d7 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:22.275905 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=6 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:22.293839 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1d4997ab-c5c3-45f7-ba81-137c0c99a1d7 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:22.294349 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1d4997ab-c5c3-45f7-ba81-137c0c99a1d7 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.295253 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1d4997ab-c5c3-45f7-ba81-137c0c99a1d7 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:22.295700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1d4997ab-c5c3-45f7-ba81-137c0c99a1d7 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.400868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=30 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:22.479343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fdb08f47-f816-4945-8bc0-26e821857286 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:22.504234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fdb08f47-f816-4945-8bc0-26e821857286 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.843065 Jul 28 03:59:22.509536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 19/49] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:21 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:22.716709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-679a8598-3eb5-47fc-a1d9-1ac46127cdb5 req-608a733c-266d-4c64-b481-5804fbc20be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29b7a8cc-247d-4e90-9d62-20d9198f0d00", "tag": "db6b2e35-38a2-486b-b449-640dc8de82c5"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:22.747227 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-679a8598-3eb5-47fc-a1d9-1ac46127cdb5 req-608a733c-266d-4c64-b481-5804fbc20be8 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:22.747987 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-679a8598-3eb5-47fc-a1d9-1ac46127cdb5 req-608a733c-266d-4c64-b481-5804fbc20be8 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.821170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-679a8598-3eb5-47fc-a1d9-1ac46127cdb5 req-608a733c-266d-4c64-b481-5804fbc20be8 service nova] Creating event network-changed:db6b2e35-38a2-486b-b449-640dc8de82c5 for instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 on hv-cinder-85127 Jul 28 03:59:22.824351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-679a8598-3eb5-47fc-a1d9-1ac46127cdb5 req-608a733c-266d-4c64-b481-5804fbc20be8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=135703) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:59:22.827116 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7adf8458-32b4-43b7-834d-32417b91a8fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:22.833373 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7adf8458-32b4-43b7-834d-32417b91a8fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.835399 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7adf8458-32b4-43b7-834d-32417b91a8fc None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:22.837492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7adf8458-32b4-43b7-834d-32417b91a8fc None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.905124 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.compute.rpcapi [None req-7adf8458-32b4-43b7-834d-32417b91a8fc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 03:59:22.905989 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7adf8458-32b4-43b7-834d-32417b91a8fc None None] Releasing lock "compute-rpcapi-router" {{(pid=135703) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:59:22.962041 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7adf8458-32b4-43b7-834d-32417b91a8fc None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428291 Jul 28 03:59:22.963502 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 20/50] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:22.978434 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9b5ba1ab-a568-4cb1-89a8-2d72cd823dc2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:22.979913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9b5ba1ab-a568-4cb1-89a8-2d72cd823dc2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:23.013720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b5ba1ab-a568-4cb1-89a8-2d72cd823dc2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:23.015695 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b5ba1ab-a568-4cb1-89a8-2d72cd823dc2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:23.019483 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b5ba1ab-a568-4cb1-89a8-2d72cd823dc2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:23.020400 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b5ba1ab-a568-4cb1-89a8-2d72cd823dc2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:23.189450 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9b5ba1ab-a568-4cb1-89a8-2d72cd823dc2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:23.198649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9b5ba1ab-a568-4cb1-89a8-2d72cd823dc2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1292 microversion: 2.1 time: 0.233440 Jul 28 03:59:23.214970 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 21/51] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:22 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1292 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:23.220850 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:23.221727 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:23.239691 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:23.245656 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:23.248538 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:23.249020 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:23.421567 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:23.466091 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:23.470183 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:23.474184 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f211795a-ea8a-48d5-91b7-3334ac2cccae tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1340 microversion: 2.20 time: 0.257658 Jul 28 03:59:23.478368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 22/52] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:23 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1340 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:23.492675 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-174eba1e-0ea7-4d5c-9830-d94b7d706ab9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:23.500644 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-174eba1e-0ea7-4d5c-9830-d94b7d706ab9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:23.523131 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-174eba1e-0ea7-4d5c-9830-d94b7d706ab9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:23.541220 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-174eba1e-0ea7-4d5c-9830-d94b7d706ab9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:23.543092 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-174eba1e-0ea7-4d5c-9830-d94b7d706ab9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:23.544323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-174eba1e-0ea7-4d5c-9830-d94b7d706ab9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:24.125392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-174eba1e-0ea7-4d5c-9830-d94b7d706ab9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:24.151094 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-174eba1e-0ea7-4d5c-9830-d94b7d706ab9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.667645 Jul 28 03:59:24.164093 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 23/53] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:23 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:24.190179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2661c0ec-36d9-4e88-981f-af1a5418be3c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:24.190971 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2661c0ec-36d9-4e88-981f-af1a5418be3c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:24.226424 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2661c0ec-36d9-4e88-981f-af1a5418be3c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:24.226973 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2661c0ec-36d9-4e88-981f-af1a5418be3c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:24.227965 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2661c0ec-36d9-4e88-981f-af1a5418be3c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:24.228425 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2661c0ec-36d9-4e88-981f-af1a5418be3c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:24.558017 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1d4997ab-c5c3-45f7-ba81-137c0c99a1d7 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:24.573158 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1d4997ab-c5c3-45f7-ba81-137c0c99a1d7 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 2.315078 Jul 28 03:59:24.576027 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 31/54] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:22 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:24.611029 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f4bf8108-ed98-4446-8a23-32a843a45520 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:24.611716 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f4bf8108-ed98-4446-8a23-32a843a45520 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:24.625894 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f4bf8108-ed98-4446-8a23-32a843a45520 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:24.626342 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f4bf8108-ed98-4446-8a23-32a843a45520 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:24.627138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f4bf8108-ed98-4446-8a23-32a843a45520 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:24.627582 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f4bf8108-ed98-4446-8a23-32a843a45520 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:24.860674 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f4bf8108-ed98-4446-8a23-32a843a45520 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:24.872094 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f4bf8108-ed98-4446-8a23-32a843a45520 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1298 microversion: 2.1 time: 0.265565 Jul 28 03:59:24.874494 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 32/55] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:24 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1298 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:24.887651 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:24.892397 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:24.908731 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:24.914788 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:24.916846 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:24.918395 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:25.264499 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:25.264499 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:25.264828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:25.264828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b5f5321b-1efa-4941-83b5-0af1c275a926 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1340 microversion: 2.20 time: 0.318577 Jul 28 03:59:25.264828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 33/56] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:24 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1340 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:25.264828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2d98dfe4-16a0-43f8-9f3c-0c7dac15516c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:25.265307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2d98dfe4-16a0-43f8-9f3c-0c7dac15516c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:25.265554 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2661c0ec-36d9-4e88-981f-af1a5418be3c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:25.265554 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2661c0ec-36d9-4e88-981f-af1a5418be3c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 1.068135 Jul 28 03:59:25.265554 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 24/57] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:24 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:25.266870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d98dfe4-16a0-43f8-9f3c-0c7dac15516c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:25.266870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d98dfe4-16a0-43f8-9f3c-0c7dac15516c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:25.266870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d98dfe4-16a0-43f8-9f3c-0c7dac15516c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:25.266870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d98dfe4-16a0-43f8-9f3c-0c7dac15516c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:25.356259 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=100 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:25.598961 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7158cb16-930e-44ff-9e18-0b3aa2691c49 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:25.599677 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7158cb16-930e-44ff-9e18-0b3aa2691c49 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:25.609934 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7158cb16-930e-44ff-9e18-0b3aa2691c49 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:25.610651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7158cb16-930e-44ff-9e18-0b3aa2691c49 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:25.619423 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7158cb16-930e-44ff-9e18-0b3aa2691c49 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:25.620163 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7158cb16-930e-44ff-9e18-0b3aa2691c49 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:26.033389 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7158cb16-930e-44ff-9e18-0b3aa2691c49 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:26.042099 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7158cb16-930e-44ff-9e18-0b3aa2691c49 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.446902 Jul 28 03:59:26.058617 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 25/58] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:25 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:26.064611 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-886498e1-98fc-4901-bcf8-3d9e19451bf2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:26.065550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-886498e1-98fc-4901-bcf8-3d9e19451bf2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:26.073922 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-886498e1-98fc-4901-bcf8-3d9e19451bf2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:26.075163 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-886498e1-98fc-4901-bcf8-3d9e19451bf2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:26.076607 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-886498e1-98fc-4901-bcf8-3d9e19451bf2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:26.077288 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-886498e1-98fc-4901-bcf8-3d9e19451bf2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:26.166278 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-886498e1-98fc-4901-bcf8-3d9e19451bf2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:26.184278 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-886498e1-98fc-4901-bcf8-3d9e19451bf2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1298 microversion: 2.1 time: 0.116799 Jul 28 03:59:26.192587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 26/59] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:26 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:26.295496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-695e905c-e121-4238-af91-0acffa1b07d8 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:26.298186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-695e905c-e121-4238-af91-0acffa1b07d8 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:26.317086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-695e905c-e121-4238-af91-0acffa1b07d8 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:26.320087 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-695e905c-e121-4238-af91-0acffa1b07d8 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:26.323625 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-695e905c-e121-4238-af91-0acffa1b07d8 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:26.323625 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-695e905c-e121-4238-af91-0acffa1b07d8 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:26.507356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2d98dfe4-16a0-43f8-9f3c-0c7dac15516c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:26.513099 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2d98dfe4-16a0-43f8-9f3c-0c7dac15516c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 1.304984 Jul 28 03:59:26.513962 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 34/60] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:25 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:26.532536 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:26.535846 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:26.557311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:26.558965 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:26.562621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:26.572222 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:26.694594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-695e905c-e121-4238-af91-0acffa1b07d8 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:26.710351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-695e905c-e121-4238-af91-0acffa1b07d8 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.421191 Jul 28 03:59:26.712253 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 27/61] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:26 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:27.064601 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-76cb4609-3a5f-4034-9604-30a5f5bdc592 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:27.065233 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-76cb4609-3a5f-4034-9604-30a5f5bdc592 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:27.085582 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76cb4609-3a5f-4034-9604-30a5f5bdc592 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.086318 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76cb4609-3a5f-4034-9604-30a5f5bdc592 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.087336 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76cb4609-3a5f-4034-9604-30a5f5bdc592 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.088025 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76cb4609-3a5f-4034-9604-30a5f5bdc592 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.419283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-76cb4609-3a5f-4034-9604-30a5f5bdc592 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:27.430759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-76cb4609-3a5f-4034-9604-30a5f5bdc592 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.368863 Jul 28 03:59:27.449459 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 28/62] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:27 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:27.455858 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ed6c5a41-3dad-446b-884c-e632eb9675b2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:27.457865 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ed6c5a41-3dad-446b-884c-e632eb9675b2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:27.471840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ed6c5a41-3dad-446b-884c-e632eb9675b2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.475922 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ed6c5a41-3dad-446b-884c-e632eb9675b2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.481461 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ed6c5a41-3dad-446b-884c-e632eb9675b2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.482094 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ed6c5a41-3dad-446b-884c-e632eb9675b2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.642730 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ed6c5a41-3dad-446b-884c-e632eb9675b2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:27.668682 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ed6c5a41-3dad-446b-884c-e632eb9675b2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1298 microversion: 2.1 time: 0.215257 Jul 28 03:59:27.671194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 29/63] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:27 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1298 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:27.688953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-083ffd1c-4915-4f49-bf85-f62e2d68d667 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:27.694948 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-083ffd1c-4915-4f49-bf85-f62e2d68d667 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:27.761242 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-083ffd1c-4915-4f49-bf85-f62e2d68d667 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.764040 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-083ffd1c-4915-4f49-bf85-f62e2d68d667 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.764040 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-083ffd1c-4915-4f49-bf85-f62e2d68d667 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.764040 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-083ffd1c-4915-4f49-bf85-f62e2d68d667 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.104681 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-083ffd1c-4915-4f49-bf85-f62e2d68d667 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.115018 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-083ffd1c-4915-4f49-bf85-f62e2d68d667 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.435872 Jul 28 03:59:28.118093 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 30/64] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:27 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:28.129664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d0e11353-2aa5-4a50-b30d-92a1a2f9509d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:28.133273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d0e11353-2aa5-4a50-b30d-92a1a2f9509d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:28.142105 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d0e11353-2aa5-4a50-b30d-92a1a2f9509d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:28.145392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d0e11353-2aa5-4a50-b30d-92a1a2f9509d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.145392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d0e11353-2aa5-4a50-b30d-92a1a2f9509d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:28.145392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d0e11353-2aa5-4a50-b30d-92a1a2f9509d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.445370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d0e11353-2aa5-4a50-b30d-92a1a2f9509d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.468853 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d0e11353-2aa5-4a50-b30d-92a1a2f9509d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.343409 Jul 28 03:59:28.481671 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 31/65] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:28 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:28.484295 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.516831 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.524319 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.525572 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2e409886-d495-4c35-b433-8ca9a64f7864 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 2.008422 Jul 28 03:59:28.526168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 35/66] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:26 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:28.554874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-95adcbe2-b239-4a8a-94e7-443c00f51034 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:28.555490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-95adcbe2-b239-4a8a-94e7-443c00f51034 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:28.564734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-95adcbe2-b239-4a8a-94e7-443c00f51034 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:28.565494 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-95adcbe2-b239-4a8a-94e7-443c00f51034 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.566565 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-95adcbe2-b239-4a8a-94e7-443c00f51034 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:28.567522 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-95adcbe2-b239-4a8a-94e7-443c00f51034 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.797320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-0b08f5c5-10fb-4c32-8384-df699599fd2a req-0b594d51-6bd9-4452-ab8c-549943fd7d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69722c89-ea87-415c-8a3c-b10f0bff6b9e", "tag": "be05219a-2802-4e35-ad33-836ad2f1d343"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:28.847823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-0b08f5c5-10fb-4c32-8384-df699599fd2a req-0b594d51-6bd9-4452-ab8c-549943fd7d0a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:28.848312 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-0b08f5c5-10fb-4c32-8384-df699599fd2a req-0b594d51-6bd9-4452-ab8c-549943fd7d0a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.886480 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-0b08f5c5-10fb-4c32-8384-df699599fd2a req-0b594d51-6bd9-4452-ab8c-549943fd7d0a service nova] Creating event network-changed:be05219a-2802-4e35-ad33-836ad2f1d343 for instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e on hv-cinder-85127 Jul 28 03:59:28.902244 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-0b08f5c5-10fb-4c32-8384-df699599fd2a req-0b594d51-6bd9-4452-ab8c-549943fd7d0a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417938 Jul 28 03:59:28.904805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 32/67] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:28.916081 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9b83cb02-b938-496e-9fb2-4b1e02abfc53 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:28.988788 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9b83cb02-b938-496e-9fb2-4b1e02abfc53 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:28.988788 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b83cb02-b938-496e-9fb2-4b1e02abfc53 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:28.988788 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b83cb02-b938-496e-9fb2-4b1e02abfc53 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.988788 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b83cb02-b938-496e-9fb2-4b1e02abfc53 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:28.989996 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b83cb02-b938-496e-9fb2-4b1e02abfc53 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.989996 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=100 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:29.025461 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9b83cb02-b938-496e-9fb2-4b1e02abfc53 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:29.045281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9b83cb02-b938-496e-9fb2-4b1e02abfc53 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1298 microversion: 2.1 time: 0.138303 Jul 28 03:59:29.046069 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 33/68] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:28 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1298 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:29.142012 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-efdf76de-0b5b-4b4e-a066-e9c8e6ebdfa8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:29.142746 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-efdf76de-0b5b-4b4e-a066-e9c8e6ebdfa8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:29.151185 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-efdf76de-0b5b-4b4e-a066-e9c8e6ebdfa8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.151726 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-efdf76de-0b5b-4b4e-a066-e9c8e6ebdfa8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:29.152701 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-efdf76de-0b5b-4b4e-a066-e9c8e6ebdfa8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.153221 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-efdf76de-0b5b-4b4e-a066-e9c8e6ebdfa8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:29.245984 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-95adcbe2-b239-4a8a-94e7-443c00f51034 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:29.259858 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-95adcbe2-b239-4a8a-94e7-443c00f51034 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.706898 Jul 28 03:59:29.261603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 36/69] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:28 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:29.342946 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-efdf76de-0b5b-4b4e-a066-e9c8e6ebdfa8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:29.356227 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-efdf76de-0b5b-4b4e-a066-e9c8e6ebdfa8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.218426 Jul 28 03:59:29.357487 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 34/70] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:29 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:29.489736 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7eef4929-61fb-4359-a087-08b77c3ceca2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:29.491649 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7eef4929-61fb-4359-a087-08b77c3ceca2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:29.504188 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7eef4929-61fb-4359-a087-08b77c3ceca2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.505299 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7eef4929-61fb-4359-a087-08b77c3ceca2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:29.506425 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7eef4929-61fb-4359-a087-08b77c3ceca2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.507116 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7eef4929-61fb-4359-a087-08b77c3ceca2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:29.558460 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:29.559867 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:29.612556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.612556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:29.612556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.612556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.027688 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.042646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.042646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.063588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-28a2df40-e0a0-4a64-a45d-81d794ee6e97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.508478 Jul 28 03:59:30.065582 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 35/71] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:29 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:30.076937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-34793395-ff0b-4896-abb7-2892ce156326 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:30.078408 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-34793395-ff0b-4896-abb7-2892ce156326 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:30.092776 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-34793395-ff0b-4896-abb7-2892ce156326 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:30.093220 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-34793395-ff0b-4896-abb7-2892ce156326 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.094010 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-34793395-ff0b-4896-abb7-2892ce156326 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:30.094510 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-34793395-ff0b-4896-abb7-2892ce156326 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.194004 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-34793395-ff0b-4896-abb7-2892ce156326 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.202454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-34793395-ff0b-4896-abb7-2892ce156326 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1298 microversion: 2.1 time: 0.135606 Jul 28 03:59:30.203033 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 36/72] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:30 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1298 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:30.311991 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5a1e2e86-111f-4393-ac99-0890e2cf741a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:30.312733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5a1e2e86-111f-4393-ac99-0890e2cf741a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:30.329353 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a1e2e86-111f-4393-ac99-0890e2cf741a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:30.329819 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a1e2e86-111f-4393-ac99-0890e2cf741a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.331156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a1e2e86-111f-4393-ac99-0890e2cf741a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:30.332076 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a1e2e86-111f-4393-ac99-0890e2cf741a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.503363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5a1e2e86-111f-4393-ac99-0890e2cf741a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.512188 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5a1e2e86-111f-4393-ac99-0890e2cf741a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.205810 Jul 28 03:59:30.512778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 37/73] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:30 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:30.530725 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-20e6f06e-ae93-4b71-8562-74aac305b821 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:30.532825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-20e6f06e-ae93-4b71-8562-74aac305b821 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:30.547287 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-20e6f06e-ae93-4b71-8562-74aac305b821 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:30.548170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-20e6f06e-ae93-4b71-8562-74aac305b821 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.549745 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-20e6f06e-ae93-4b71-8562-74aac305b821 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:30.550509 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-20e6f06e-ae93-4b71-8562-74aac305b821 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.613849 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7eef4929-61fb-4359-a087-08b77c3ceca2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.624072 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7eef4929-61fb-4359-a087-08b77c3ceca2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 1.138354 Jul 28 03:59:30.624876 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 37/74] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:29 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:30.713831 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-20e6f06e-ae93-4b71-8562-74aac305b821 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.720226 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-20e6f06e-ae93-4b71-8562-74aac305b821 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.205201 Jul 28 03:59:30.721430 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 38/75] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:30 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:31.040683 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-f5927946-916f-458e-8b1a-b4f10162ddc3 req-3330482e-e4eb-4067-b5ad-96100f1038f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30f5c60-8ee4-4d46-aec9-34dd464d21b9", "tag": "a308124a-65b2-45a7-b6e2-c3a47f628499"}, {"name": "network-changed", "server_uuid": "2c0a06d3-c137-4eba-a44e-271a29b12e38", "tag": "17c86bfa-053e-4c3a-bef0-ab77101531bb"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:31.060384 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-f5927946-916f-458e-8b1a-b4f10162ddc3 req-3330482e-e4eb-4067-b5ad-96100f1038f5 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.060932 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-f5927946-916f-458e-8b1a-b4f10162ddc3 req-3330482e-e4eb-4067-b5ad-96100f1038f5 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.089618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-f5927946-916f-458e-8b1a-b4f10162ddc3 req-3330482e-e4eb-4067-b5ad-96100f1038f5 service nova] Creating event network-changed:a308124a-65b2-45a7-b6e2-c3a47f628499 for instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 on hv-cinder-85127 Jul 28 03:59:31.090063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-f5927946-916f-458e-8b1a-b4f10162ddc3 req-3330482e-e4eb-4067-b5ad-96100f1038f5 service nova] Creating event network-changed:17c86bfa-053e-4c3a-bef0-ab77101531bb for instance 2c0a06d3-c137-4eba-a44e-271a29b12e38 on hv-cinder-85127 Jul 28 03:59:31.090936 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-f5927946-916f-458e-8b1a-b4f10162ddc3 req-3330482e-e4eb-4067-b5ad-96100f1038f5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=135704) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:59:31.093031 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c8317838-895c-422c-bca6-3e64372e546c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.093791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c8317838-895c-422c-bca6-3e64372e546c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.097987 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c8317838-895c-422c-bca6-3e64372e546c None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.098332 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:31.098447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c8317838-895c-422c-bca6-3e64372e546c None None] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.098553 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:31.105843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.106302 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.107089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.107644 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.109180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.compute.rpcapi [None req-c8317838-895c-422c-bca6-3e64372e546c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 03:59:31.110630 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c8317838-895c-422c-bca6-3e64372e546c None None] Releasing lock "compute-rpcapi-router" {{(pid=135704) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:59:31.143475 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c8317838-895c-422c-bca6-3e64372e546c None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.107649 Jul 28 03:59:31.149753 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 38/76] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:31.226099 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ddfa43aa-3f90-43f2-8ff4-4438c268267e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:31.227012 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ddfa43aa-3f90-43f2-8ff4-4438c268267e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:31.239036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ddfa43aa-3f90-43f2-8ff4-4438c268267e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.245697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ddfa43aa-3f90-43f2-8ff4-4438c268267e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.247082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ddfa43aa-3f90-43f2-8ff4-4438c268267e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.247575 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ddfa43aa-3f90-43f2-8ff4-4438c268267e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.399748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.415250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.415250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.415250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3ff186f9-cb43-45e7-a999-4ab94c11629f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.327640 Jul 28 03:59:31.429415 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 39/77] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:31 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:31.535854 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-51b43efa-0507-42b1-a0c8-59ba900526ee tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:31.536819 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-51b43efa-0507-42b1-a0c8-59ba900526ee tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:31.550401 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51b43efa-0507-42b1-a0c8-59ba900526ee tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.551104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51b43efa-0507-42b1-a0c8-59ba900526ee tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.552136 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51b43efa-0507-42b1-a0c8-59ba900526ee tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.553277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51b43efa-0507-42b1-a0c8-59ba900526ee tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.633876 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ddfa43aa-3f90-43f2-8ff4-4438c268267e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.636608 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=34 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:31.643476 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ddfa43aa-3f90-43f2-8ff4-4438c268267e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.422587 Jul 28 03:59:31.644515 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 39/78] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:31 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:31.649265 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9866a0b6-f982-4537-9cac-765db7bf540e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:31.649966 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9866a0b6-f982-4537-9cac-765db7bf540e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:31.664042 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9866a0b6-f982-4537-9cac-765db7bf540e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.664740 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9866a0b6-f982-4537-9cac-765db7bf540e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.667467 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9866a0b6-f982-4537-9cac-765db7bf540e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.667467 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9866a0b6-f982-4537-9cac-765db7bf540e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.781049 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-51b43efa-0507-42b1-a0c8-59ba900526ee tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.807735 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-51b43efa-0507-42b1-a0c8-59ba900526ee tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.275567 Jul 28 03:59:31.808865 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 40/79] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:31 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:31.817237 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0cba759f-4d97-48df-9ac9-539ae6400591 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:31.819731 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0cba759f-4d97-48df-9ac9-539ae6400591 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:31.841654 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9866a0b6-f982-4537-9cac-765db7bf540e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.845062 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cba759f-4d97-48df-9ac9-539ae6400591 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.845626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cba759f-4d97-48df-9ac9-539ae6400591 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.846578 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cba759f-4d97-48df-9ac9-539ae6400591 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.847207 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cba759f-4d97-48df-9ac9-539ae6400591 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.850848 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9866a0b6-f982-4537-9cac-765db7bf540e tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.205158 Jul 28 03:59:31.851545 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 40/80] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:31 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:31.988759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0cba759f-4d97-48df-9ac9-539ae6400591 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.997198 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0cba759f-4d97-48df-9ac9-539ae6400591 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.186986 Jul 28 03:59:31.998572 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 41/81] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:31 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:32.441757 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.442372 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:32.450546 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.451013 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.451801 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.452306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.668309 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f590bfa6-afb0-45f2-ab50-36e52988cc61 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.668937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f590bfa6-afb0-45f2-ab50-36e52988cc61 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:32.676249 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f590bfa6-afb0-45f2-ab50-36e52988cc61 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.676776 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f590bfa6-afb0-45f2-ab50-36e52988cc61 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.677553 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f590bfa6-afb0-45f2-ab50-36e52988cc61 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.680098 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f590bfa6-afb0-45f2-ab50-36e52988cc61 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.692643 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.709835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.711370 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.712711 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-30bbeb76-3e36-4c44-adb1-7a2c38ec461c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.274843 Jul 28 03:59:32.713419 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 41/82] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:32.829352 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f96f5c37-cd6c-441d-8299-c9a5812d7607 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.829998 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f96f5c37-cd6c-441d-8299-c9a5812d7607 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:32.837210 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f96f5c37-cd6c-441d-8299-c9a5812d7607 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.837660 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f96f5c37-cd6c-441d-8299-c9a5812d7607 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.838666 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f96f5c37-cd6c-441d-8299-c9a5812d7607 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.839268 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f96f5c37-cd6c-441d-8299-c9a5812d7607 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.868196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f590bfa6-afb0-45f2-ab50-36e52988cc61 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.886649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f590bfa6-afb0-45f2-ab50-36e52988cc61 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.223225 Jul 28 03:59:32.901471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 42/83] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:32.907573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b7ad0bf6-869c-4a93-a65f-6df96804e708 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.909882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b7ad0bf6-869c-4a93-a65f-6df96804e708 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:32.914662 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=8 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:32.916521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b7ad0bf6-869c-4a93-a65f-6df96804e708 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.917371 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b7ad0bf6-869c-4a93-a65f-6df96804e708 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.918546 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b7ad0bf6-869c-4a93-a65f-6df96804e708 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.919174 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b7ad0bf6-869c-4a93-a65f-6df96804e708 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.144879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b7ad0bf6-869c-4a93-a65f-6df96804e708 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:33.158235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b7ad0bf6-869c-4a93-a65f-6df96804e708 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.255532 Jul 28 03:59:33.162135 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 43/84] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:33.164061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-523c6846-a0c3-47b5-a19b-e2e1bfc9ab5f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:33.164893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-523c6846-a0c3-47b5-a19b-e2e1bfc9ab5f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:33.173768 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-523c6846-a0c3-47b5-a19b-e2e1bfc9ab5f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.174312 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-523c6846-a0c3-47b5-a19b-e2e1bfc9ab5f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.175262 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-523c6846-a0c3-47b5-a19b-e2e1bfc9ab5f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.175851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-523c6846-a0c3-47b5-a19b-e2e1bfc9ab5f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.235052 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f96f5c37-cd6c-441d-8299-c9a5812d7607 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:33.246310 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f96f5c37-cd6c-441d-8299-c9a5812d7607 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.420438 Jul 28 03:59:33.247500 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 42/85] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:33.265205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-f2c1e571-4b73-42f4-9555-c9b8814da117 req-2d0dbfd9-acf0-48fa-8f32-db781f5e8b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eadfe50-2ab9-46dc-be42-b9496e4008ac", "tag": "ef1e8289-929e-424e-b1c1-98a45ed868ea"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:33.280518 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-f2c1e571-4b73-42f4-9555-c9b8814da117 req-2d0dbfd9-acf0-48fa-8f32-db781f5e8b21 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.280975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-f2c1e571-4b73-42f4-9555-c9b8814da117 req-2d0dbfd9-acf0-48fa-8f32-db781f5e8b21 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.300502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-f2c1e571-4b73-42f4-9555-c9b8814da117 req-2d0dbfd9-acf0-48fa-8f32-db781f5e8b21 service nova] Creating event network-changed:ef1e8289-929e-424e-b1c1-98a45ed868ea for instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac on hv-cinder-85127 Jul 28 03:59:33.307239 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-f2c1e571-4b73-42f4-9555-c9b8814da117 req-2d0dbfd9-acf0-48fa-8f32-db781f5e8b21 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057956 Jul 28 03:59:33.307859 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 43/86] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:33.406781 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-523c6846-a0c3-47b5-a19b-e2e1bfc9ab5f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:33.416224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-523c6846-a0c3-47b5-a19b-e2e1bfc9ab5f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.256258 Jul 28 03:59:33.417027 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 44/87] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:33 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:33.736662 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:33.737358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:33.744634 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.745091 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.745871 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.746305 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.885161 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:33.893158 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:33.894656 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:33.895770 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6d3388ab-4c43-449a-a148-ecc4098559bb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.163592 Jul 28 03:59:33.896354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 44/88] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:33 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:33.915079 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-56b3faa9-7ff5-4760-a9f9-e67a7affb860 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:33.915720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-56b3faa9-7ff5-4760-a9f9-e67a7affb860 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:33.922769 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-56b3faa9-7ff5-4760-a9f9-e67a7affb860 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.923268 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-56b3faa9-7ff5-4760-a9f9-e67a7affb860 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.924144 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-56b3faa9-7ff5-4760-a9f9-e67a7affb860 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.924598 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-56b3faa9-7ff5-4760-a9f9-e67a7affb860 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.057936 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-56b3faa9-7ff5-4760-a9f9-e67a7affb860 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:34.065571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-56b3faa9-7ff5-4760-a9f9-e67a7affb860 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.155332 Jul 28 03:59:34.066139 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 45/89] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:33 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:34.180202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f44c1d40-7a43-4ad8-b447-33fcabef3203 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:34.181138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f44c1d40-7a43-4ad8-b447-33fcabef3203 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:34.187709 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f44c1d40-7a43-4ad8-b447-33fcabef3203 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.188218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f44c1d40-7a43-4ad8-b447-33fcabef3203 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.189018 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f44c1d40-7a43-4ad8-b447-33fcabef3203 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.189566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f44c1d40-7a43-4ad8-b447-33fcabef3203 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.269334 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4997b57f-9794-44ce-9f1b-61b92bbdadd4 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:34.269947 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4997b57f-9794-44ce-9f1b-61b92bbdadd4 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:34.277004 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4997b57f-9794-44ce-9f1b-61b92bbdadd4 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.282669 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4997b57f-9794-44ce-9f1b-61b92bbdadd4 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.282669 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4997b57f-9794-44ce-9f1b-61b92bbdadd4 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.282669 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4997b57f-9794-44ce-9f1b-61b92bbdadd4 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.355267 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f44c1d40-7a43-4ad8-b447-33fcabef3203 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:34.363489 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f44c1d40-7a43-4ad8-b447-33fcabef3203 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.188236 Jul 28 03:59:34.364189 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 45/90] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:34 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:34.437835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-23d4e449-05da-42e9-aa4e-ea08e76c11f5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:34.438613 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-23d4e449-05da-42e9-aa4e-ea08e76c11f5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:34.447570 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4997b57f-9794-44ce-9f1b-61b92bbdadd4 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:34.457037 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4997b57f-9794-44ce-9f1b-61b92bbdadd4 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.191107 Jul 28 03:59:34.457840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 46/91] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:34 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:34.464033 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-23d4e449-05da-42e9-aa4e-ea08e76c11f5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.464510 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-23d4e449-05da-42e9-aa4e-ea08e76c11f5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.465336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-23d4e449-05da-42e9-aa4e-ea08e76c11f5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.465784 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-23d4e449-05da-42e9-aa4e-ea08e76c11f5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.921851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:34.922535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:34.941063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.941524 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.942310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.942753 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.089547 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.097709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.099219 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.101071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1c9e7486-122b-4a5e-bd61-b2a8596f346b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.185505 Jul 28 03:59:35.101635 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 47/92] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:34 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:35.106189 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b299cd9d-f1c1-48ed-8121-6e96f60fcc35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:35.106800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b299cd9d-f1c1-48ed-8121-6e96f60fcc35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:35.121224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b299cd9d-f1c1-48ed-8121-6e96f60fcc35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:35.121970 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b299cd9d-f1c1-48ed-8121-6e96f60fcc35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.122759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b299cd9d-f1c1-48ed-8121-6e96f60fcc35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:35.123213 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b299cd9d-f1c1-48ed-8121-6e96f60fcc35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.307047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b299cd9d-f1c1-48ed-8121-6e96f60fcc35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.316218 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b299cd9d-f1c1-48ed-8121-6e96f60fcc35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.213450 Jul 28 03:59:35.317441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 48/93] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:35 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:35.362118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-83258ff3-ae44-47a2-8658-6fede98025a9 req-24178aac-cc86-44fc-96ae-d00617a55771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce0e823-630b-4503-9b49-e9d5d43b2605", "tag": "fb9b0d27-d368-47b4-869d-588f9411de37"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:35.384322 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-83258ff3-ae44-47a2-8658-6fede98025a9 req-24178aac-cc86-44fc-96ae-d00617a55771 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:35.385639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-83258ff3-ae44-47a2-8658-6fede98025a9 req-24178aac-cc86-44fc-96ae-d00617a55771 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.398650 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-23d4e449-05da-42e9-aa4e-ea08e76c11f5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.435413 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-23d4e449-05da-42e9-aa4e-ea08e76c11f5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.996766 Jul 28 03:59:35.436398 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-83258ff3-ae44-47a2-8658-6fede98025a9 req-24178aac-cc86-44fc-96ae-d00617a55771 service nova] Creating event network-changed:fb9b0d27-d368-47b4-869d-588f9411de37 for instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 on hv-cinder-85127 Jul 28 03:59:35.448926 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-83258ff3-ae44-47a2-8658-6fede98025a9 req-24178aac-cc86-44fc-96ae-d00617a55771 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088157 Jul 28 03:59:35.451134 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 46/95] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:34 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:35.451280 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 49/95] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:35.458642 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c381f8a3-332e-4e4e-bbb1-069783b57add tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:35.461683 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c381f8a3-332e-4e4e-bbb1-069783b57add tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:35.483886 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a9a8b812-6041-4bb1-8fda-abe69369ffed tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:35.483886 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a9a8b812-6041-4bb1-8fda-abe69369ffed tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:35.496063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a9a8b812-6041-4bb1-8fda-abe69369ffed tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:35.496523 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a9a8b812-6041-4bb1-8fda-abe69369ffed tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.497144 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c381f8a3-332e-4e4e-bbb1-069783b57add tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:35.497566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a9a8b812-6041-4bb1-8fda-abe69369ffed tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:35.498004 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a9a8b812-6041-4bb1-8fda-abe69369ffed tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.500320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c381f8a3-332e-4e4e-bbb1-069783b57add tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.501321 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c381f8a3-332e-4e4e-bbb1-069783b57add tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:35.502566 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c381f8a3-332e-4e4e-bbb1-069783b57add tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.767068 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c381f8a3-332e-4e4e-bbb1-069783b57add tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.780411 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=100 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:35.786476 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c381f8a3-332e-4e4e-bbb1-069783b57add tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.333638 Jul 28 03:59:35.788378 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 50/96] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:35 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:36.130267 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:36.132161 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:36.158914 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.159387 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.160284 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.160977 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.339485 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a9a8b812-6041-4bb1-8fda-abe69369ffed tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.351994 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a9a8b812-6041-4bb1-8fda-abe69369ffed tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.874932 Jul 28 03:59:36.353466 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 47/97] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:35 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:36.359648 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-bf82ec3d-e9ec-4d3c-ae3b-d8f9e6b16930 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:36.360606 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-bf82ec3d-e9ec-4d3c-ae3b-d8f9e6b16930 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:36.372907 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf82ec3d-e9ec-4d3c-ae3b-d8f9e6b16930 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.373980 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf82ec3d-e9ec-4d3c-ae3b-d8f9e6b16930 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.375320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf82ec3d-e9ec-4d3c-ae3b-d8f9e6b16930 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.376020 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf82ec3d-e9ec-4d3c-ae3b-d8f9e6b16930 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.380541 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.397958 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.410851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.413392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9918cc0e-a4b3-40e8-ac46-4b421ceb2277 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.291134 Jul 28 03:59:36.414796 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 51/98] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:36 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:36.457647 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-51ea2407-2f8a-4e04-8e7f-1d11902d2725 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:36.458256 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-51ea2407-2f8a-4e04-8e7f-1d11902d2725 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:36.469813 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51ea2407-2f8a-4e04-8e7f-1d11902d2725 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.471446 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51ea2407-2f8a-4e04-8e7f-1d11902d2725 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.473806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51ea2407-2f8a-4e04-8e7f-1d11902d2725 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.476549 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51ea2407-2f8a-4e04-8e7f-1d11902d2725 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.590139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bf82ec3d-e9ec-4d3c-ae3b-d8f9e6b16930 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.602005 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-bf82ec3d-e9ec-4d3c-ae3b-d8f9e6b16930 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.244542 Jul 28 03:59:36.602642 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 48/99] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:36 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:36.658756 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-51ea2407-2f8a-4e04-8e7f-1d11902d2725 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.667860 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-51ea2407-2f8a-4e04-8e7f-1d11902d2725 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.213505 Jul 28 03:59:36.668643 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 52/100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:36 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:36.808489 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-12b7ee68-c7e0-4acc-a189-f266c1c200ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:36.809119 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-12b7ee68-c7e0-4acc-a189-f266c1c200ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:36.815136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12b7ee68-c7e0-4acc-a189-f266c1c200ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.815594 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12b7ee68-c7e0-4acc-a189-f266c1c200ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.816463 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12b7ee68-c7e0-4acc-a189-f266c1c200ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.816909 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12b7ee68-c7e0-4acc-a189-f266c1c200ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.958556 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-12b7ee68-c7e0-4acc-a189-f266c1c200ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.965782 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-12b7ee68-c7e0-4acc-a189-f266c1c200ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.161208 Jul 28 03:59:36.979923 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 49/101] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:36 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:37.376201 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bbf012ec-6d54-4dda-a95d-5b669530735d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:37.376823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-bbf012ec-6d54-4dda-a95d-5b669530735d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:37.384827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bbf012ec-6d54-4dda-a95d-5b669530735d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.385441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bbf012ec-6d54-4dda-a95d-5b669530735d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.386522 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bbf012ec-6d54-4dda-a95d-5b669530735d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.387716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bbf012ec-6d54-4dda-a95d-5b669530735d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.437725 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:37.438493 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:37.450383 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.464751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.465874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.466582 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.637079 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-bbf012ec-6d54-4dda-a95d-5b669530735d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:37.644162 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-bbf012ec-6d54-4dda-a95d-5b669530735d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.271717 Jul 28 03:59:37.645572 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 53/102] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:37 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:37.652488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-64e7cf3e-e904-4608-bbac-497cd4a9f6b6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:37.653668 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-64e7cf3e-e904-4608-bbac-497cd4a9f6b6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:37.665670 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-64e7cf3e-e904-4608-bbac-497cd4a9f6b6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.666170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-64e7cf3e-e904-4608-bbac-497cd4a9f6b6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.670893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-64e7cf3e-e904-4608-bbac-497cd4a9f6b6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.671639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-64e7cf3e-e904-4608-bbac-497cd4a9f6b6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.701781 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:37.712979 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:37.716983 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:37.719483 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-09228f04-a9f8-4767-aa48-edddcf56c3da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.285977 Jul 28 03:59:37.721669 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 50/103] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:37 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:37.734560 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b3c6b25f-7676-41b3-ad3e-418db67dc9f8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:37.735431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b3c6b25f-7676-41b3-ad3e-418db67dc9f8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:37.749821 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b3c6b25f-7676-41b3-ad3e-418db67dc9f8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.750242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b3c6b25f-7676-41b3-ad3e-418db67dc9f8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.751037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b3c6b25f-7676-41b3-ad3e-418db67dc9f8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.751485 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b3c6b25f-7676-41b3-ad3e-418db67dc9f8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.891430 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-64e7cf3e-e904-4608-bbac-497cd4a9f6b6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:37.902587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-64e7cf3e-e904-4608-bbac-497cd4a9f6b6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.255634 Jul 28 03:59:37.904191 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 54/104] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:37 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:37.987388 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6a8effa6-2c63-42d8-9461-ae6692ef0cff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:37.988040 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6a8effa6-2c63-42d8-9461-ae6692ef0cff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:38.003905 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a8effa6-2c63-42d8-9461-ae6692ef0cff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.004550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a8effa6-2c63-42d8-9461-ae6692ef0cff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.005178 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a8effa6-2c63-42d8-9461-ae6692ef0cff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.005731 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a8effa6-2c63-42d8-9461-ae6692ef0cff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.188552 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6a8effa6-2c63-42d8-9461-ae6692ef0cff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:38.197668 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6a8effa6-2c63-42d8-9461-ae6692ef0cff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.214009 Jul 28 03:59:38.213861 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 55/105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:37 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:38.234655 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b3c6b25f-7676-41b3-ad3e-418db67dc9f8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:38.245220 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b3c6b25f-7676-41b3-ad3e-418db67dc9f8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.519339 Jul 28 03:59:38.247153 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 51/106] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:37 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:38.668946 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-86ac5e0d-3713-45f1-a81e-0c69ca149f9d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:38.669513 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-86ac5e0d-3713-45f1-a81e-0c69ca149f9d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:38.679677 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-86ac5e0d-3713-45f1-a81e-0c69ca149f9d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.680404 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-86ac5e0d-3713-45f1-a81e-0c69ca149f9d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.681351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-86ac5e0d-3713-45f1-a81e-0c69ca149f9d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.681948 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-86ac5e0d-3713-45f1-a81e-0c69ca149f9d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.747243 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:38.748952 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:38.756089 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.757054 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.758145 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.759018 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.764339 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=100 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:38.854976 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-86ac5e0d-3713-45f1-a81e-0c69ca149f9d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:38.878686 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-86ac5e0d-3713-45f1-a81e-0c69ca149f9d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.214290 Jul 28 03:59:38.883207 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 56/107] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:38 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:38.926780 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-cc6142de-71d7-4194-b3ca-808ac8e848f7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:38.927387 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-cc6142de-71d7-4194-b3ca-808ac8e848f7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:38.940953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cc6142de-71d7-4194-b3ca-808ac8e848f7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.941803 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cc6142de-71d7-4194-b3ca-808ac8e848f7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.944706 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cc6142de-71d7-4194-b3ca-808ac8e848f7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.945233 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cc6142de-71d7-4194-b3ca-808ac8e848f7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:39.104529 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cc6142de-71d7-4194-b3ca-808ac8e848f7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:39.114447 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-cc6142de-71d7-4194-b3ca-808ac8e848f7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.191530 Jul 28 03:59:39.115310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 57/108] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:38 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:39.201426 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:39.223321 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:39.225362 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:39.229278 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0933a12b-a016-453b-acd1-0b19bf2e2055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:39.232257 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0933a12b-a016-453b-acd1-0b19bf2e2055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:39.234358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-cce65ff5-fe7c-41e3-aa54-1d0b3a44c6fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.491524 Jul 28 03:59:39.235728 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 52/109] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:38 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:39.243118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0933a12b-a016-453b-acd1-0b19bf2e2055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.243661 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0933a12b-a016-453b-acd1-0b19bf2e2055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:39.244550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0933a12b-a016-453b-acd1-0b19bf2e2055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.245064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0933a12b-a016-453b-acd1-0b19bf2e2055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:39.271311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-648ae5fc-ed5a-4d16-bf41-8abf98a809cc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:39.273646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-648ae5fc-ed5a-4d16-bf41-8abf98a809cc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:39.282684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-648ae5fc-ed5a-4d16-bf41-8abf98a809cc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.283138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-648ae5fc-ed5a-4d16-bf41-8abf98a809cc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:39.284007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-648ae5fc-ed5a-4d16-bf41-8abf98a809cc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.284457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-648ae5fc-ed5a-4d16-bf41-8abf98a809cc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:39.465326 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0933a12b-a016-453b-acd1-0b19bf2e2055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:39.479931 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0933a12b-a016-453b-acd1-0b19bf2e2055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.260832 Jul 28 03:59:39.480660 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 58/110] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:39 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:39.793681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-648ae5fc-ed5a-4d16-bf41-8abf98a809cc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:39.804290 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-648ae5fc-ed5a-4d16-bf41-8abf98a809cc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.540578 Jul 28 03:59:39.808469 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 53/111] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:39 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:39.909353 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-16854059-f6e2-4035-9f3f-af9d37a24e94 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:39.910937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-16854059-f6e2-4035-9f3f-af9d37a24e94 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:39.913111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:39.918051 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-16854059-f6e2-4035-9f3f-af9d37a24e94 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.918599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-16854059-f6e2-4035-9f3f-af9d37a24e94 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:39.919595 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-16854059-f6e2-4035-9f3f-af9d37a24e94 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.920145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-16854059-f6e2-4035-9f3f-af9d37a24e94 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.112898 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-16854059-f6e2-4035-9f3f-af9d37a24e94 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.128955 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-16854059-f6e2-4035-9f3f-af9d37a24e94 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.222324 Jul 28 03:59:40.130229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 59/112] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:39 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:40.144165 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-14ad3e43-3537-467f-bd98-cfbf3d3f2416 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:40.144799 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-14ad3e43-3537-467f-bd98-cfbf3d3f2416 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:40.155318 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-14ad3e43-3537-467f-bd98-cfbf3d3f2416 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.156230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-14ad3e43-3537-467f-bd98-cfbf3d3f2416 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.157678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-14ad3e43-3537-467f-bd98-cfbf3d3f2416 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.158360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-14ad3e43-3537-467f-bd98-cfbf3d3f2416 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.384081 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-732c5a52-3867-4197-85c9-7ac4c7db516a req-9435e970-7221-4c9d-bdf9-db66bed56ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30f5c60-8ee4-4d46-aec9-34dd464d21b9", "name": "network-vif-plugged", "status": "completed", "tag": "a308124a-65b2-45a7-b6e2-c3a47f628499"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:40.397828 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-732c5a52-3867-4197-85c9-7ac4c7db516a req-9435e970-7221-4c9d-bdf9-db66bed56ba5 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.397828 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-732c5a52-3867-4197-85c9-7ac4c7db516a req-9435e970-7221-4c9d-bdf9-db66bed56ba5 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.402756 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-14ad3e43-3537-467f-bd98-cfbf3d3f2416 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.409184 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-732c5a52-3867-4197-85c9-7ac4c7db516a req-9435e970-7221-4c9d-bdf9-db66bed56ba5 service nova] Creating event network-vif-plugged:a308124a-65b2-45a7-b6e2-c3a47f628499 for instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 on hv-cinder-85127 Jul 28 03:59:40.412316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-14ad3e43-3537-467f-bd98-cfbf3d3f2416 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.277931 Jul 28 03:59:40.415480 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-732c5a52-3867-4197-85c9-7ac4c7db516a req-9435e970-7221-4c9d-bdf9-db66bed56ba5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209623 Jul 28 03:59:40.416753 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 60/113] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:40.424594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:40.425638 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:40.431368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 54/114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:40 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:40.435467 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.436018 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.437919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.437919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.503188 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b3681f68-9d64-4f55-b169-afc000511c47 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:40.503823 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b3681f68-9d64-4f55-b169-afc000511c47 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:40.511788 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b3681f68-9d64-4f55-b169-afc000511c47 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.512595 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b3681f68-9d64-4f55-b169-afc000511c47 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.513480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b3681f68-9d64-4f55-b169-afc000511c47 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.513926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b3681f68-9d64-4f55-b169-afc000511c47 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.622912 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.642960 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.645679 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.650494 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d6b43345-885b-4d74-9033-8a38d7ea9103 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.231622 Jul 28 03:59:40.653138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 61/115] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:40 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:40.772457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b3681f68-9d64-4f55-b169-afc000511c47 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.784675 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b3681f68-9d64-4f55-b169-afc000511c47 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.285145 Jul 28 03:59:40.784675 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 55/116] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:40 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:40.834341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aed32f6c-2521-4e48-afa5-9dbc7cb57ec5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:40.835025 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-aed32f6c-2521-4e48-afa5-9dbc7cb57ec5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:40.849434 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aed32f6c-2521-4e48-afa5-9dbc7cb57ec5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.850550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aed32f6c-2521-4e48-afa5-9dbc7cb57ec5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.851273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aed32f6c-2521-4e48-afa5-9dbc7cb57ec5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.851791 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aed32f6c-2521-4e48-afa5-9dbc7cb57ec5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.017066 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aed32f6c-2521-4e48-afa5-9dbc7cb57ec5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:41.029721 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-aed32f6c-2521-4e48-afa5-9dbc7cb57ec5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.196038 Jul 28 03:59:41.029721 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 62/117] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:40 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:41.157571 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3f5ab7d9-91dc-4ee7-a4f3-721924bdd258 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:41.158772 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3f5ab7d9-91dc-4ee7-a4f3-721924bdd258 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:41.161378 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:41.167389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3f5ab7d9-91dc-4ee7-a4f3-721924bdd258 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.167849 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3f5ab7d9-91dc-4ee7-a4f3-721924bdd258 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.168670 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3f5ab7d9-91dc-4ee7-a4f3-721924bdd258 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.169281 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3f5ab7d9-91dc-4ee7-a4f3-721924bdd258 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.335231 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-3f5ab7d9-91dc-4ee7-a4f3-721924bdd258 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:41.342634 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3f5ab7d9-91dc-4ee7-a4f3-721924bdd258 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.189059 Jul 28 03:59:41.343593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 56/118] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:41 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:41.440841 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-393be1d7-f965-43c0-8792-d2311a3f5179 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:41.441474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-393be1d7-f965-43c0-8792-d2311a3f5179 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:41.448723 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-393be1d7-f965-43c0-8792-d2311a3f5179 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.449186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-393be1d7-f965-43c0-8792-d2311a3f5179 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.449998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-393be1d7-f965-43c0-8792-d2311a3f5179 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.450438 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-393be1d7-f965-43c0-8792-d2311a3f5179 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.634712 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-393be1d7-f965-43c0-8792-d2311a3f5179 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:41.642833 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-393be1d7-f965-43c0-8792-d2311a3f5179 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.207729 Jul 28 03:59:41.645150 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 63/119] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:41 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:41.678736 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:41.680211 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:41.698759 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.699553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.700624 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.702012 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.805193 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c733b3d6-6882-45be-ba3d-8b9a071c34bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:41.805818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c733b3d6-6882-45be-ba3d-8b9a071c34bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:41.813030 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c733b3d6-6882-45be-ba3d-8b9a071c34bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.813568 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c733b3d6-6882-45be-ba3d-8b9a071c34bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.817382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c733b3d6-6882-45be-ba3d-8b9a071c34bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.817382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c733b3d6-6882-45be-ba3d-8b9a071c34bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.973587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c733b3d6-6882-45be-ba3d-8b9a071c34bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:41.982544 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c733b3d6-6882-45be-ba3d-8b9a071c34bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.181353 Jul 28 03:59:41.983331 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 64/120] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:41 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:42.049315 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-daa2bad9-eb94-4acf-ad5c-ea1db0577716 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:42.050051 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-daa2bad9-eb94-4acf-ad5c-ea1db0577716 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:42.057599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-daa2bad9-eb94-4acf-ad5c-ea1db0577716 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:42.058535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-daa2bad9-eb94-4acf-ad5c-ea1db0577716 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.059329 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-daa2bad9-eb94-4acf-ad5c-ea1db0577716 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:42.059769 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-daa2bad9-eb94-4acf-ad5c-ea1db0577716 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.068064 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.097674 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.101652 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.103139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-393a820a-7bd1-43c6-8a8e-b7250e2c50dc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.429812 Jul 28 03:59:42.104476 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 57/121] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:41 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:42.244909 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-daa2bad9-eb94-4acf-ad5c-ea1db0577716 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.253297 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-daa2bad9-eb94-4acf-ad5c-ea1db0577716 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.207914 Jul 28 03:59:42.254215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 65/122] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:42 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:42.363086 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3ba76df9-09d2-4089-b58c-85864a3391ae tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:42.363695 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3ba76df9-09d2-4089-b58c-85864a3391ae tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:42.370464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3ba76df9-09d2-4089-b58c-85864a3391ae tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:42.370913 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3ba76df9-09d2-4089-b58c-85864a3391ae tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.371912 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3ba76df9-09d2-4089-b58c-85864a3391ae tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:42.372389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3ba76df9-09d2-4089-b58c-85864a3391ae tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.431857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-08cf2a7b-95d4-4c59-83ea-43c2f5873f0d req-65bec431-8525-4460-8821-7bd2f09e025e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69722c89-ea87-415c-8a3c-b10f0bff6b9e", "name": "network-vif-plugged", "status": "completed", "tag": "be05219a-2802-4e35-ad33-836ad2f1d343"}, {"server_uuid": "29b7a8cc-247d-4e90-9d62-20d9198f0d00", "name": "network-vif-plugged", "status": "completed", "tag": "db6b2e35-38a2-486b-b449-640dc8de82c5"}, {"server_uuid": "2c0a06d3-c137-4eba-a44e-271a29b12e38", "name": "network-vif-plugged", "status": "completed", "tag": "17c86bfa-053e-4c3a-bef0-ab77101531bb"}, {"server_uuid": "4eadfe50-2ab9-46dc-be42-b9496e4008ac", "name": "network-vif-plugged", "status": "completed", "tag": "ef1e8289-929e-424e-b1c1-98a45ed868ea"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:42.446015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-08cf2a7b-95d4-4c59-83ea-43c2f5873f0d req-65bec431-8525-4460-8821-7bd2f09e025e service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:42.450984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-08cf2a7b-95d4-4c59-83ea-43c2f5873f0d req-65bec431-8525-4460-8821-7bd2f09e025e service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.469880 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-08cf2a7b-95d4-4c59-83ea-43c2f5873f0d req-65bec431-8525-4460-8821-7bd2f09e025e service nova] Creating event network-vif-plugged:be05219a-2802-4e35-ad33-836ad2f1d343 for instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e on hv-cinder-85127 Jul 28 03:59:42.470389 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-08cf2a7b-95d4-4c59-83ea-43c2f5873f0d req-65bec431-8525-4460-8821-7bd2f09e025e service nova] Creating event network-vif-plugged:db6b2e35-38a2-486b-b449-640dc8de82c5 for instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 on hv-cinder-85127 Jul 28 03:59:42.471103 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-08cf2a7b-95d4-4c59-83ea-43c2f5873f0d req-65bec431-8525-4460-8821-7bd2f09e025e service nova] Creating event network-vif-plugged:17c86bfa-053e-4c3a-bef0-ab77101531bb for instance 2c0a06d3-c137-4eba-a44e-271a29b12e38 on hv-cinder-85127 Jul 28 03:59:42.471601 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-08cf2a7b-95d4-4c59-83ea-43c2f5873f0d req-65bec431-8525-4460-8821-7bd2f09e025e service nova] Creating event network-vif-plugged:ef1e8289-929e-424e-b1c1-98a45ed868ea for instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac on hv-cinder-85127 Jul 28 03:59:42.484200 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-08cf2a7b-95d4-4c59-83ea-43c2f5873f0d req-65bec431-8525-4460-8821-7bd2f09e025e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.056684 Jul 28 03:59:42.485437 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 66/123] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:42.554223 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-3ba76df9-09d2-4089-b58c-85864a3391ae tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.562046 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3ba76df9-09d2-4089-b58c-85864a3391ae tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.202674 Jul 28 03:59:42.574460 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 58/124] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:42 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:42.668095 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-65c02b9b-1b8b-4da3-bbcb-2d420be06bca tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:42.668714 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-65c02b9b-1b8b-4da3-bbcb-2d420be06bca tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:42.674975 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-65c02b9b-1b8b-4da3-bbcb-2d420be06bca tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:42.675428 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-65c02b9b-1b8b-4da3-bbcb-2d420be06bca tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.676231 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-65c02b9b-1b8b-4da3-bbcb-2d420be06bca tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:42.676669 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-65c02b9b-1b8b-4da3-bbcb-2d420be06bca tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.826036 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-65c02b9b-1b8b-4da3-bbcb-2d420be06bca tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.838022 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-65c02b9b-1b8b-4da3-bbcb-2d420be06bca tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.173501 Jul 28 03:59:42.840018 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 67/125] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:42 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:43.003866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c9f77559-e0df-4547-b2f4-acc227e471c9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:43.004512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c9f77559-e0df-4547-b2f4-acc227e471c9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:43.011970 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c9f77559-e0df-4547-b2f4-acc227e471c9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.012542 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c9f77559-e0df-4547-b2f4-acc227e471c9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.013218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c9f77559-e0df-4547-b2f4-acc227e471c9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.013753 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c9f77559-e0df-4547-b2f4-acc227e471c9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.129761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:43.131834 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:43.139160 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.140137 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.141172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.141958 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.206551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c9f77559-e0df-4547-b2f4-acc227e471c9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:43.215980 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c9f77559-e0df-4547-b2f4-acc227e471c9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.215827 Jul 28 03:59:43.216597 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 59/126] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:42 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:43.281368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b10a4553-24d5-4497-9f0c-753db702ca53 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:43.286654 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b10a4553-24d5-4497-9f0c-753db702ca53 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:43.303177 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b10a4553-24d5-4497-9f0c-753db702ca53 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.304916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b10a4553-24d5-4497-9f0c-753db702ca53 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.316679 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b10a4553-24d5-4497-9f0c-753db702ca53 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.317696 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b10a4553-24d5-4497-9f0c-753db702ca53 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.352356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:43.356478 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=100 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:43.364410 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:43.366594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:43.368030 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f035cfa9-09d4-4a7c-b977-3e876bb623ca tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.243675 Jul 28 03:59:43.384835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 68/127] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:43 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:43.586943 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b170d674-b65f-4144-a271-e1067467aedb tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:43.588072 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b170d674-b65f-4144-a271-e1067467aedb tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:43.595565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b170d674-b65f-4144-a271-e1067467aedb tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.596980 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b170d674-b65f-4144-a271-e1067467aedb tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.597849 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b170d674-b65f-4144-a271-e1067467aedb tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.598405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b170d674-b65f-4144-a271-e1067467aedb tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.696938 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b10a4553-24d5-4497-9f0c-753db702ca53 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:43.704749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b10a4553-24d5-4497-9f0c-753db702ca53 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.430369 Jul 28 03:59:43.705310 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 60/128] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:43 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:43.811157 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b170d674-b65f-4144-a271-e1067467aedb tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:43.820118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b170d674-b65f-4144-a271-e1067467aedb tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.239417 Jul 28 03:59:43.821259 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 69/129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:43 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:43.860046 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-535f0956-0fbf-400c-883c-3e8130b41ad5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:43.860861 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-535f0956-0fbf-400c-883c-3e8130b41ad5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:43.869205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-535f0956-0fbf-400c-883c-3e8130b41ad5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.870067 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-535f0956-0fbf-400c-883c-3e8130b41ad5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.871037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-535f0956-0fbf-400c-883c-3e8130b41ad5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.871668 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-535f0956-0fbf-400c-883c-3e8130b41ad5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.078357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-535f0956-0fbf-400c-883c-3e8130b41ad5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:44.080419 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-535f0956-0fbf-400c-883c-3e8130b41ad5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.224772 Jul 28 03:59:44.080999 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 61/130] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:43 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:44.238958 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-520d2496-15b7-4604-8b9e-c2c51ad23230 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:44.239509 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-520d2496-15b7-4604-8b9e-c2c51ad23230 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:44.248729 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-520d2496-15b7-4604-8b9e-c2c51ad23230 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.249437 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-520d2496-15b7-4604-8b9e-c2c51ad23230 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.251794 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-520d2496-15b7-4604-8b9e-c2c51ad23230 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.251794 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-520d2496-15b7-4604-8b9e-c2c51ad23230 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.385231 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-520d2496-15b7-4604-8b9e-c2c51ad23230 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:44.391020 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:44.391926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:44.393598 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-520d2496-15b7-4604-8b9e-c2c51ad23230 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.159296 Jul 28 03:59:44.402941 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.403695 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.404537 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.406202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.407452 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 70/131] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:44 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:44.503525 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-92f022ee-14ae-4360-adc3-2551cf47a9b6 req-2c8f29c2-de2e-462c-b97e-e0b4b59ee715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce0e823-630b-4503-9b49-e9d5d43b2605", "name": "network-vif-plugged", "status": "completed", "tag": "fb9b0d27-d368-47b4-869d-588f9411de37"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:44.513019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-92f022ee-14ae-4360-adc3-2551cf47a9b6 req-2c8f29c2-de2e-462c-b97e-e0b4b59ee715 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.513468 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-92f022ee-14ae-4360-adc3-2551cf47a9b6 req-2c8f29c2-de2e-462c-b97e-e0b4b59ee715 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.525087 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-92f022ee-14ae-4360-adc3-2551cf47a9b6 req-2c8f29c2-de2e-462c-b97e-e0b4b59ee715 service nova] Creating event network-vif-plugged:fb9b0d27-d368-47b4-869d-588f9411de37 for instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 on hv-cinder-85127 Jul 28 03:59:44.530377 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-92f022ee-14ae-4360-adc3-2551cf47a9b6 req-2c8f29c2-de2e-462c-b97e-e0b4b59ee715 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030744 Jul 28 03:59:44.531798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 71/132] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:44.545476 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:44.554499 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:44.556026 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:44.557132 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-439caf1b-bcf4-4fe1-8fe0-9e60abe11ad2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.170464 Jul 28 03:59:44.557695 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 62/133] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:44 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:44.726844 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-02639184-6b25-4871-acff-87d35685f9eb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:44.727540 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-02639184-6b25-4871-acff-87d35685f9eb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:44.736396 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-02639184-6b25-4871-acff-87d35685f9eb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.736854 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-02639184-6b25-4871-acff-87d35685f9eb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.737680 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-02639184-6b25-4871-acff-87d35685f9eb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.738246 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-02639184-6b25-4871-acff-87d35685f9eb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.842921 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2aa9b8e1-862a-4c41-bcfa-c3c66c77668b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:44.844095 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2aa9b8e1-862a-4c41-bcfa-c3c66c77668b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:44.851138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2aa9b8e1-862a-4c41-bcfa-c3c66c77668b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.851604 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2aa9b8e1-862a-4c41-bcfa-c3c66c77668b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.852419 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2aa9b8e1-862a-4c41-bcfa-c3c66c77668b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.853102 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2aa9b8e1-862a-4c41-bcfa-c3c66c77668b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.936700 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-02639184-6b25-4871-acff-87d35685f9eb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:44.946960 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-02639184-6b25-4871-acff-87d35685f9eb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.224765 Jul 28 03:59:44.948034 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 72/134] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:44 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:45.069290 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2aa9b8e1-862a-4c41-bcfa-c3c66c77668b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.077138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2aa9b8e1-862a-4c41-bcfa-c3c66c77668b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1315 microversion: 2.1 time: 0.238185 Jul 28 03:59:45.090279 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 63/135] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:44 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:45.102326 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fb717a2c-06a9-43cb-9e17-4525fc3d86e3 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.102974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fb717a2c-06a9-43cb-9e17-4525fc3d86e3 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:45.109617 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fb717a2c-06a9-43cb-9e17-4525fc3d86e3 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.110146 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fb717a2c-06a9-43cb-9e17-4525fc3d86e3 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.111003 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fb717a2c-06a9-43cb-9e17-4525fc3d86e3 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.111545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fb717a2c-06a9-43cb-9e17-4525fc3d86e3 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.272639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fb717a2c-06a9-43cb-9e17-4525fc3d86e3 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.280801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fb717a2c-06a9-43cb-9e17-4525fc3d86e3 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.183147 Jul 28 03:59:45.288497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 73/136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:45 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:45.415508 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-389ce3f5-75d0-444f-915c-8ab85db7f9f1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.416267 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-389ce3f5-75d0-444f-915c-8ab85db7f9f1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:45.422255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-389ce3f5-75d0-444f-915c-8ab85db7f9f1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.422749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-389ce3f5-75d0-444f-915c-8ab85db7f9f1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.423525 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-389ce3f5-75d0-444f-915c-8ab85db7f9f1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.423978 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-389ce3f5-75d0-444f-915c-8ab85db7f9f1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.561714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-389ce3f5-75d0-444f-915c-8ab85db7f9f1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.569370 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-389ce3f5-75d0-444f-915c-8ab85db7f9f1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1364 microversion: 2.1 time: 0.158804 Jul 28 03:59:45.569946 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 64/137] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:45 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:45.580546 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.581241 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:45.587906 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.588396 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.589159 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.589594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.745974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.762466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.772795 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.774681 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-aad6f0e8-83d4-4e3e-beb8-f28985338fc5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1408 microversion: 2.20 time: 0.197821 Jul 28 03:59:45.775848 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 74/138] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:45 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:45.967881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-dce03880-91d1-4193-bd6c-2a560077b2e1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.968575 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-dce03880-91d1-4193-bd6c-2a560077b2e1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:45.975986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-dce03880-91d1-4193-bd6c-2a560077b2e1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.977783 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-dce03880-91d1-4193-bd6c-2a560077b2e1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.977783 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-dce03880-91d1-4193-bd6c-2a560077b2e1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.977783 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-dce03880-91d1-4193-bd6c-2a560077b2e1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.097667 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d400c5ce-ad51-4264-8727-898ba129316b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:46.098284 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d400c5ce-ad51-4264-8727-898ba129316b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:46.105830 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d400c5ce-ad51-4264-8727-898ba129316b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.106660 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d400c5ce-ad51-4264-8727-898ba129316b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.107575 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d400c5ce-ad51-4264-8727-898ba129316b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.108321 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d400c5ce-ad51-4264-8727-898ba129316b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.166213 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-dce03880-91d1-4193-bd6c-2a560077b2e1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:46.173317 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-dce03880-91d1-4193-bd6c-2a560077b2e1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.209340 Jul 28 03:59:46.174263 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 65/139] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:45 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:46.305235 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e73d5c7e-4ca4-46cc-839e-079f8ead0434 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:46.306108 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e73d5c7e-4ca4-46cc-839e-079f8ead0434 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:46.315703 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e73d5c7e-4ca4-46cc-839e-079f8ead0434 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.316545 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e73d5c7e-4ca4-46cc-839e-079f8ead0434 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.318300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e73d5c7e-4ca4-46cc-839e-079f8ead0434 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.319598 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e73d5c7e-4ca4-46cc-839e-079f8ead0434 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.320770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d400c5ce-ad51-4264-8727-898ba129316b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:46.335578 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d400c5ce-ad51-4264-8727-898ba129316b tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1501 microversion: 2.1 time: 0.241657 Jul 28 03:59:46.348043 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 75/140] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:46 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:46.493558 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e73d5c7e-4ca4-46cc-839e-079f8ead0434 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:46.509009 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e73d5c7e-4ca4-46cc-839e-079f8ead0434 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.210778 Jul 28 03:59:46.511114 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 66/141] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:46 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:46.593111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7c63dbdc-822f-4db4-aa37-fcef643bd47f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:46.594020 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7c63dbdc-822f-4db4-aa37-fcef643bd47f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:46.601365 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7c63dbdc-822f-4db4-aa37-fcef643bd47f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.601907 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7c63dbdc-822f-4db4-aa37-fcef643bd47f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.603019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7c63dbdc-822f-4db4-aa37-fcef643bd47f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.603463 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7c63dbdc-822f-4db4-aa37-fcef643bd47f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.759351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7c63dbdc-822f-4db4-aa37-fcef643bd47f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:46.767818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7c63dbdc-822f-4db4-aa37-fcef643bd47f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1549 microversion: 2.1 time: 0.178699 Jul 28 03:59:46.768979 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 76/142] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:46 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1549 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:46.792641 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3f85c339-aa0e-447c-b2bf-6cfe9c335064 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:46.793513 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3f85c339-aa0e-447c-b2bf-6cfe9c335064 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:46.804183 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:46.806706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3f85c339-aa0e-447c-b2bf-6cfe9c335064 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.807368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3f85c339-aa0e-447c-b2bf-6cfe9c335064 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.808274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3f85c339-aa0e-447c-b2bf-6cfe9c335064 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.808966 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3f85c339-aa0e-447c-b2bf-6cfe9c335064 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.809844 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:46.831449 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.832058 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.832768 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.833497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.951486 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3f85c339-aa0e-447c-b2bf-6cfe9c335064 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163921 Jul 28 03:59:46.956527 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 67/143] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Jul 28 03:59:46 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:47.030626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.047435 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.050488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.051933 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-22319e3b-0b1b-4d71-987a-7e3c892e00ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1600 microversion: 2.20 time: 0.254130 Jul 28 03:59:47.052788 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 77/144] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:46 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1600 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:47.078587 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d8f42912-d744-4eca-b957-4d2406d5850d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:47.079159 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d8f42912-d744-4eca-b957-4d2406d5850d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:47.093229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d8f42912-d744-4eca-b957-4d2406d5850d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.094991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d8f42912-d744-4eca-b957-4d2406d5850d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.096286 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d8f42912-d744-4eca-b957-4d2406d5850d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.097103 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d8f42912-d744-4eca-b957-4d2406d5850d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.196427 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-59abfbf7-3308-4f8b-83c6-80b08c2dbbc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:47.197127 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-59abfbf7-3308-4f8b-83c6-80b08c2dbbc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:47.213631 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59abfbf7-3308-4f8b-83c6-80b08c2dbbc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.215763 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59abfbf7-3308-4f8b-83c6-80b08c2dbbc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.216697 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59abfbf7-3308-4f8b-83c6-80b08c2dbbc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.219068 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59abfbf7-3308-4f8b-83c6-80b08c2dbbc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.269971 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d8f42912-d744-4eca-b957-4d2406d5850d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.190367 Jul 28 03:59:47.269971 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 68/145] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Jul 28 03:59:47 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:59:47.530358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-74f95dfd-ad51-41ff-94dd-93b01d745c40 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:47.530999 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-74f95dfd-ad51-41ff-94dd-93b01d745c40 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:47.542549 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-74f95dfd-ad51-41ff-94dd-93b01d745c40 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.543319 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-74f95dfd-ad51-41ff-94dd-93b01d745c40 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.544307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-74f95dfd-ad51-41ff-94dd-93b01d745c40 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.545034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-74f95dfd-ad51-41ff-94dd-93b01d745c40 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.573357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=100 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:47.680691 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-59abfbf7-3308-4f8b-83c6-80b08c2dbbc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.693356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-59abfbf7-3308-4f8b-83c6-80b08c2dbbc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1322 microversion: 2.1 time: 0.502829 Jul 28 03:59:47.707286 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 78/146] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:47 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:48.156594 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-74f95dfd-ad51-41ff-94dd-93b01d745c40 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:48.167130 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-74f95dfd-ad51-41ff-94dd-93b01d745c40 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.640068 Jul 28 03:59:48.181986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 69/147] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:47 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:48.298059 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-06be1062-28af-4353-87cb-1bdd7644bc6f tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b18fbf68-32dc-4758-8da2-179bfc1dcb61"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:48.301306 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-06be1062-28af-4353-87cb-1bdd7644bc6f tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:48.314021 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-06be1062-28af-4353-87cb-1bdd7644bc6f tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.314470 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-06be1062-28af-4353-87cb-1bdd7644bc6f tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:48.315363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-06be1062-28af-4353-87cb-1bdd7644bc6f tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.315912 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-06be1062-28af-4353-87cb-1bdd7644bc6f tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:48.715813 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2bec337e-b583-489b-a3b2-b279cea3df47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:48.716396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2bec337e-b583-489b-a3b2-b279cea3df47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:48.718216 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=87 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:48.726658 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2bec337e-b583-489b-a3b2-b279cea3df47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.727353 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2bec337e-b583-489b-a3b2-b279cea3df47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:48.728210 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2bec337e-b583-489b-a3b2-b279cea3df47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.728861 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2bec337e-b583-489b-a3b2-b279cea3df47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:48.980668 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2bec337e-b583-489b-a3b2-b279cea3df47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:48.997211 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2bec337e-b583-489b-a3b2-b279cea3df47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1516 microversion: 2.1 time: 0.284833 Jul 28 03:59:48.997987 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 70/148] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:48 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1516 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:49.012054 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-2ce77aa4-edc5-46dc-a1b4-887087772cf8 req-05f53578-5f66-4e45-9fba-29d5f213ecd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69722c89-ea87-415c-8a3c-b10f0bff6b9e", "tag": "be05219a-2802-4e35-ad33-836ad2f1d343"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:49.030196 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-2ce77aa4-edc5-46dc-a1b4-887087772cf8 req-05f53578-5f66-4e45-9fba-29d5f213ecd9 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.030840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-2ce77aa4-edc5-46dc-a1b4-887087772cf8 req-05f53578-5f66-4e45-9fba-29d5f213ecd9 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.044458 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-2ce77aa4-edc5-46dc-a1b4-887087772cf8 req-05f53578-5f66-4e45-9fba-29d5f213ecd9 service nova] Creating event network-changed:be05219a-2802-4e35-ad33-836ad2f1d343 for instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e on hv-cinder-85127 Jul 28 03:59:49.050013 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-2ce77aa4-edc5-46dc-a1b4-887087772cf8 req-05f53578-5f66-4e45-9fba-29d5f213ecd9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050697 Jul 28 03:59:49.050674 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 71/149] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:49.069930 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b78e7664-fbe0-4649-8e24-8c9fe42e2450 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:49.073767 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b78e7664-fbe0-4649-8e24-8c9fe42e2450 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:49.080840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b78e7664-fbe0-4649-8e24-8c9fe42e2450 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.091480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b78e7664-fbe0-4649-8e24-8c9fe42e2450 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.093341 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b78e7664-fbe0-4649-8e24-8c9fe42e2450 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.093975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b78e7664-fbe0-4649-8e24-8c9fe42e2450 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.120579 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-b78e7664-fbe0-4649-8e24-8c9fe42e2450 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lazy-loading 'flavor' on Instance uuid 2c0a06d3-c137-4eba-a44e-271a29b12e38 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:59:49.544613 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b78e7664-fbe0-4649-8e24-8c9fe42e2450 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38/action" status: 200 len: 32 microversion: 2.1 time: 0.485048 Jul 28 03:59:49.545213 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 72/150] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 03:59:49 2022] POST /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38/action => generated 32 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:59:49.550353 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1504bc87-14e5-4467-8f57-e3ec97ec152d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:49.551061 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1504bc87-14e5-4467-8f57-e3ec97ec152d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:49.573034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1504bc87-14e5-4467-8f57-e3ec97ec152d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.577127 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1504bc87-14e5-4467-8f57-e3ec97ec152d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.577127 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1504bc87-14e5-4467-8f57-e3ec97ec152d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.577127 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1504bc87-14e5-4467-8f57-e3ec97ec152d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.045256 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1504bc87-14e5-4467-8f57-e3ec97ec152d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:50.075782 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1504bc87-14e5-4467-8f57-e3ec97ec152d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1365 microversion: 2.1 time: 0.529244 Jul 28 03:59:50.076770 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 73/151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:49 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1365 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:50.120832 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-93c6d4d2-6aad-4afc-bf6e-33ac45bd3882 req-adc5ea28-fdf1-41da-bc3f-48fddee7e0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eadfe50-2ab9-46dc-be42-b9496e4008ac", "tag": "ef1e8289-929e-424e-b1c1-98a45ed868ea"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:50.184467 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-93c6d4d2-6aad-4afc-bf6e-33ac45bd3882 req-adc5ea28-fdf1-41da-bc3f-48fddee7e0fb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.188883 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-93c6d4d2-6aad-4afc-bf6e-33ac45bd3882 req-adc5ea28-fdf1-41da-bc3f-48fddee7e0fb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.269204 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-93c6d4d2-6aad-4afc-bf6e-33ac45bd3882 req-adc5ea28-fdf1-41da-bc3f-48fddee7e0fb service nova] Creating event network-changed:ef1e8289-929e-424e-b1c1-98a45ed868ea for instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac on hv-cinder-85127 Jul 28 03:59:50.284745 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-93c6d4d2-6aad-4afc-bf6e-33ac45bd3882 req-adc5ea28-fdf1-41da-bc3f-48fddee7e0fb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206433 Jul 28 03:59:50.286800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 74/152] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:50.300296 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-53848dab-a10d-463d-b8aa-c4b4efaa678e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:50.303355 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-53848dab-a10d-463d-b8aa-c4b4efaa678e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:50.309454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-06be1062-28af-4353-87cb-1bdd7644bc6f tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "POST /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.015064 Jul 28 03:59:50.310324 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 79/153] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 03:59:48 2022] POST /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00/os-volume_attachments => generated 194 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:50.324376 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-53848dab-a10d-463d-b8aa-c4b4efaa678e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.327334 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-53848dab-a10d-463d-b8aa-c4b4efaa678e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.329807 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-53848dab-a10d-463d-b8aa-c4b4efaa678e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.330429 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-53848dab-a10d-463d-b8aa-c4b4efaa678e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.653696 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-53848dab-a10d-463d-b8aa-c4b4efaa678e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:50.674238 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-53848dab-a10d-463d-b8aa-c4b4efaa678e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.381351 Jul 28 03:59:50.675048 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 75/154] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:50 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:51.103979 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c404852a-9e66-4479-b80f-b61676ac2240 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:51.105594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c404852a-9e66-4479-b80f-b61676ac2240 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:51.112528 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c404852a-9e66-4479-b80f-b61676ac2240 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.113270 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c404852a-9e66-4479-b80f-b61676ac2240 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.114983 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c404852a-9e66-4479-b80f-b61676ac2240 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.116710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c404852a-9e66-4479-b80f-b61676ac2240 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.353909 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c404852a-9e66-4479-b80f-b61676ac2240 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:51.362710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c404852a-9e66-4479-b80f-b61676ac2240 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1555 microversion: 2.1 time: 0.264680 Jul 28 03:59:51.363308 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 80/155] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:51 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1555 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:51.389486 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5857cde9-eef7-45d0-bcf8-3a7dbc001d32 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:51.390239 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5857cde9-eef7-45d0-bcf8-3a7dbc001d32 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:51.399517 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5857cde9-eef7-45d0-bcf8-3a7dbc001d32 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.400410 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5857cde9-eef7-45d0-bcf8-3a7dbc001d32 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.402598 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5857cde9-eef7-45d0-bcf8-3a7dbc001d32 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.403352 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5857cde9-eef7-45d0-bcf8-3a7dbc001d32 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.700936 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-440adfe9-06cb-4109-bd9c-fdcf59bb1aa3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:51.703222 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-440adfe9-06cb-4109-bd9c-fdcf59bb1aa3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:51.714642 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-440adfe9-06cb-4109-bd9c-fdcf59bb1aa3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.715810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-440adfe9-06cb-4109-bd9c-fdcf59bb1aa3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.717329 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-440adfe9-06cb-4109-bd9c-fdcf59bb1aa3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.718307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-440adfe9-06cb-4109-bd9c-fdcf59bb1aa3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.821246 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5857cde9-eef7-45d0-bcf8-3a7dbc001d32 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.431776 Jul 28 03:59:51.822120 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 76/156] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Jul 28 03:59:51 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-interface => generated 284 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:52.142267 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-440adfe9-06cb-4109-bd9c-fdcf59bb1aa3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:52.151491 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-440adfe9-06cb-4109-bd9c-fdcf59bb1aa3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.459140 Jul 28 03:59:52.152100 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 81/157] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:51 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:53.177173 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-68262783-1c3e-4541-8a10-ac038f99b1d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:53.177876 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-68262783-1c3e-4541-8a10-ac038f99b1d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:53.184878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-68262783-1c3e-4541-8a10-ac038f99b1d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:53.185522 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-68262783-1c3e-4541-8a10-ac038f99b1d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:53.186711 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-68262783-1c3e-4541-8a10-ac038f99b1d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:53.187157 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-68262783-1c3e-4541-8a10-ac038f99b1d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:53.333915 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-68262783-1c3e-4541-8a10-ac038f99b1d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:53.342073 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-68262783-1c3e-4541-8a10-ac038f99b1d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.172625 Jul 28 03:59:53.342646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 77/158] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:53 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:53.709231 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-ffd444ca-a12d-4560-afce-a8fe68f405c5 req-b8e3ccfb-0f38-4151-a2d8-fdf945765db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce0e823-630b-4503-9b49-e9d5d43b2605", "tag": "fb9b0d27-d368-47b4-869d-588f9411de37"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:53.723498 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-ffd444ca-a12d-4560-afce-a8fe68f405c5 req-b8e3ccfb-0f38-4151-a2d8-fdf945765db4 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:53.724375 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-ffd444ca-a12d-4560-afce-a8fe68f405c5 req-b8e3ccfb-0f38-4151-a2d8-fdf945765db4 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:53.743004 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-ffd444ca-a12d-4560-afce-a8fe68f405c5 req-b8e3ccfb-0f38-4151-a2d8-fdf945765db4 service nova] Creating event network-changed:fb9b0d27-d368-47b4-869d-588f9411de37 for instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 on hv-cinder-85127 Jul 28 03:59:53.754287 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-ffd444ca-a12d-4560-afce-a8fe68f405c5 req-b8e3ccfb-0f38-4151-a2d8-fdf945765db4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052648 Jul 28 03:59:53.755104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 82/159] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:54.364258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f3002157-3094-4ce4-b087-4e7a86599f4a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:54.365470 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f3002157-3094-4ce4-b087-4e7a86599f4a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:54.388716 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f3002157-3094-4ce4-b087-4e7a86599f4a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:54.389184 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f3002157-3094-4ce4-b087-4e7a86599f4a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:54.389985 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f3002157-3094-4ce4-b087-4e7a86599f4a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:54.390846 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f3002157-3094-4ce4-b087-4e7a86599f4a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:54.658795 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f3002157-3094-4ce4-b087-4e7a86599f4a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:54.669973 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f3002157-3094-4ce4-b087-4e7a86599f4a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.309714 Jul 28 03:59:54.670557 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 78/160] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:54 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:55.694159 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-91438974-7e57-44bd-a75e-94af6df7763b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:55.696007 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-91438974-7e57-44bd-a75e-94af6df7763b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:55.703249 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-91438974-7e57-44bd-a75e-94af6df7763b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:55.703768 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-91438974-7e57-44bd-a75e-94af6df7763b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:55.704601 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-91438974-7e57-44bd-a75e-94af6df7763b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:55.705328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-91438974-7e57-44bd-a75e-94af6df7763b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:55.923832 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-91438974-7e57-44bd-a75e-94af6df7763b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:55.933096 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-91438974-7e57-44bd-a75e-94af6df7763b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.244151 Jul 28 03:59:55.933925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 83/161] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:55 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:56.959024 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8ece75f6-0b94-4254-ae63-ec4378ef3dc3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:56.961004 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8ece75f6-0b94-4254-ae63-ec4378ef3dc3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:56.968311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ece75f6-0b94-4254-ae63-ec4378ef3dc3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:56.969013 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ece75f6-0b94-4254-ae63-ec4378ef3dc3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:56.972027 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ece75f6-0b94-4254-ae63-ec4378ef3dc3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:56.976678 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ece75f6-0b94-4254-ae63-ec4378ef3dc3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:57.168444 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8ece75f6-0b94-4254-ae63-ec4378ef3dc3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:57.176643 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8ece75f6-0b94-4254-ae63-ec4378ef3dc3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.224949 Jul 28 03:59:57.177232 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 79/162] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:56 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:58.199179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7353668a-7839-4356-af41-0b6fcf22d386 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:58.199786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7353668a-7839-4356-af41-0b6fcf22d386 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:58.206887 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7353668a-7839-4356-af41-0b6fcf22d386 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:58.207421 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7353668a-7839-4356-af41-0b6fcf22d386 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:58.208136 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7353668a-7839-4356-af41-0b6fcf22d386 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:58.208741 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7353668a-7839-4356-af41-0b6fcf22d386 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:58.401993 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7353668a-7839-4356-af41-0b6fcf22d386 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:58.410305 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7353668a-7839-4356-af41-0b6fcf22d386 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.214797 Jul 28 03:59:58.411460 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 84/163] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:58 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:59.436303 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b896270c-4f8b-4d42-a7c1-ec8ae0bfa239 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:59.437018 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b896270c-4f8b-4d42-a7c1-ec8ae0bfa239 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:59.444991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b896270c-4f8b-4d42-a7c1-ec8ae0bfa239 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:59.445452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b896270c-4f8b-4d42-a7c1-ec8ae0bfa239 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:59.446268 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b896270c-4f8b-4d42-a7c1-ec8ae0bfa239 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:59.446726 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b896270c-4f8b-4d42-a7c1-ec8ae0bfa239 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:59.627167 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b896270c-4f8b-4d42-a7c1-ec8ae0bfa239 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:59.635143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b896270c-4f8b-4d42-a7c1-ec8ae0bfa239 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.205086 Jul 28 03:59:59.635716 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 80/164] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:59 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:00.655575 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-beb12203-244b-4546-8417-586c88d21f4d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:00.656220 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-beb12203-244b-4546-8417-586c88d21f4d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:00.662684 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-beb12203-244b-4546-8417-586c88d21f4d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.663188 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-beb12203-244b-4546-8417-586c88d21f4d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.664015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-beb12203-244b-4546-8417-586c88d21f4d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.664471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-beb12203-244b-4546-8417-586c88d21f4d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.690998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:00.826042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-beb12203-244b-4546-8417-586c88d21f4d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:00.841283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-beb12203-244b-4546-8417-586c88d21f4d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.189422 Jul 28 04:00:00.841909 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 85/165] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:00 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:01.315989 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9010f8e3-6687-4168-acff-537469b40366 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:01.319698 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9010f8e3-6687-4168-acff-537469b40366 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:01.324983 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9010f8e3-6687-4168-acff-537469b40366 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.325574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9010f8e3-6687-4168-acff-537469b40366 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.326428 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9010f8e3-6687-4168-acff-537469b40366 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.327126 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9010f8e3-6687-4168-acff-537469b40366 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.354245 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9010f8e3-6687-4168-acff-537469b40366 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:00:01.753411 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9010f8e3-6687-4168-acff-537469b40366 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "DELETE /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 204 len: 0 microversion: 2.1 time: 0.441383 Jul 28 04:00:01.755288 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 81/166] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:00:01 2022] DELETE /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:00:01.765556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-93c28a15-1cd4-444d-ad08-a177cd3ae458 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:01.766795 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-93c28a15-1cd4-444d-ad08-a177cd3ae458 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:01.788647 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-93c28a15-1cd4-444d-ad08-a177cd3ae458 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.790296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-93c28a15-1cd4-444d-ad08-a177cd3ae458 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.790296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-93c28a15-1cd4-444d-ad08-a177cd3ae458 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.790515 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-93c28a15-1cd4-444d-ad08-a177cd3ae458 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.863360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-aabb3674-3986-4c3d-88e2-95e4ac453554 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:01.864392 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-aabb3674-3986-4c3d-88e2-95e4ac453554 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:01.883777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aabb3674-3986-4c3d-88e2-95e4ac453554 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.884362 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aabb3674-3986-4c3d-88e2-95e4ac453554 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.885215 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aabb3674-3986-4c3d-88e2-95e4ac453554 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.885663 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aabb3674-3986-4c3d-88e2-95e4ac453554 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:02.031658 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-93c28a15-1cd4-444d-ad08-a177cd3ae458 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:02.043986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-93c28a15-1cd4-444d-ad08-a177cd3ae458 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1553 microversion: 2.1 time: 0.283664 Jul 28 04:00:02.056840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 86/167] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:01 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1553 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:02.056995 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-aabb3674-3986-4c3d-88e2-95e4ac453554 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:02.078959 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-aabb3674-3986-4c3d-88e2-95e4ac453554 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.219806 Jul 28 04:00:02.093569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 82/168] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:01 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:03.069854 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-da873c8a-8a23-4ad6-ab32-52eb51c0dfe8 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:03.071494 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-da873c8a-8a23-4ad6-ab32-52eb51c0dfe8 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:03.080304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-da873c8a-8a23-4ad6-ab32-52eb51c0dfe8 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.081117 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-da873c8a-8a23-4ad6-ab32-52eb51c0dfe8 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.081905 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-da873c8a-8a23-4ad6-ab32-52eb51c0dfe8 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.082350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-da873c8a-8a23-4ad6-ab32-52eb51c0dfe8 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.102537 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4367bfc3-bd78-4747-a5ac-bba78650e003 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:03.103581 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4367bfc3-bd78-4747-a5ac-bba78650e003 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:03.114702 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4367bfc3-bd78-4747-a5ac-bba78650e003 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.115305 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4367bfc3-bd78-4747-a5ac-bba78650e003 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.116306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4367bfc3-bd78-4747-a5ac-bba78650e003 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.117050 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4367bfc3-bd78-4747-a5ac-bba78650e003 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.332560 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4367bfc3-bd78-4747-a5ac-bba78650e003 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:03.344062 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-da873c8a-8a23-4ad6-ab32-52eb51c0dfe8 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:03.346739 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4367bfc3-bd78-4747-a5ac-bba78650e003 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.249625 Jul 28 04:00:03.347529 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 83/169] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:03 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:03.353406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-da873c8a-8a23-4ad6-ab32-52eb51c0dfe8 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1553 microversion: 2.1 time: 0.288181 Jul 28 04:00:03.354727 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 87/170] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:03 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1553 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:04.377072 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a57a9b22-0e75-48d0-85c8-96a68dc5150d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:04.378623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c260cf48-6eda-4da9-b7ee-a9ec4daec79f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:04.379130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a57a9b22-0e75-48d0-85c8-96a68dc5150d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:04.379506 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c260cf48-6eda-4da9-b7ee-a9ec4daec79f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:04.389013 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a57a9b22-0e75-48d0-85c8-96a68dc5150d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.389752 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a57a9b22-0e75-48d0-85c8-96a68dc5150d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.391027 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a57a9b22-0e75-48d0-85c8-96a68dc5150d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.391435 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c260cf48-6eda-4da9-b7ee-a9ec4daec79f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.392031 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a57a9b22-0e75-48d0-85c8-96a68dc5150d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.392149 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c260cf48-6eda-4da9-b7ee-a9ec4daec79f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.393749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c260cf48-6eda-4da9-b7ee-a9ec4daec79f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.394650 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c260cf48-6eda-4da9-b7ee-a9ec4daec79f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.418349 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:04.597226 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a57a9b22-0e75-48d0-85c8-96a68dc5150d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:04.609926 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a57a9b22-0e75-48d0-85c8-96a68dc5150d tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1553 microversion: 2.1 time: 0.237898 Jul 28 04:00:04.610513 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 88/171] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:04 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:04.762393 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c260cf48-6eda-4da9-b7ee-a9ec4daec79f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:04.772803 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c260cf48-6eda-4da9-b7ee-a9ec4daec79f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.403641 Jul 28 04:00:04.773311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 84/172] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:04 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:05.604171 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-5eb96aaa-edeb-4c54-9290-17b4ef5d7d53 req-df513804-495a-41bd-bf69-3763afb7709b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29b7a8cc-247d-4e90-9d62-20d9198f0d00", "name": "network-vif-deleted", "tag": "db6b2e35-38a2-486b-b449-640dc8de82c5"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:05.625700 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-5eb96aaa-edeb-4c54-9290-17b4ef5d7d53 req-df513804-495a-41bd-bf69-3763afb7709b service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.626092 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-5eb96aaa-edeb-4c54-9290-17b4ef5d7d53 req-df513804-495a-41bd-bf69-3763afb7709b service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.632672 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7ce1e6b9-26c0-4d3d-aa6f-9865888aa99a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:05.637431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7ce1e6b9-26c0-4d3d-aa6f-9865888aa99a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:05.644360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7ce1e6b9-26c0-4d3d-aa6f-9865888aa99a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.644827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7ce1e6b9-26c0-4d3d-aa6f-9865888aa99a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.645618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7ce1e6b9-26c0-4d3d-aa6f-9865888aa99a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.646067 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7ce1e6b9-26c0-4d3d-aa6f-9865888aa99a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.658654 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-5eb96aaa-edeb-4c54-9290-17b4ef5d7d53 req-df513804-495a-41bd-bf69-3763afb7709b service nova] Creating event network-vif-deleted:db6b2e35-38a2-486b-b449-640dc8de82c5 for instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 on hv-cinder-85127 Jul 28 04:00:05.665850 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-5eb96aaa-edeb-4c54-9290-17b4ef5d7d53 req-df513804-495a-41bd-bf69-3763afb7709b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065786 Jul 28 04:00:05.671870 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 89/173] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:00:05.738315 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7ce1e6b9-26c0-4d3d-aa6f-9865888aa99a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:05.750753 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7ce1e6b9-26c0-4d3d-aa6f-9865888aa99a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1511 microversion: 2.1 time: 0.122746 Jul 28 04:00:05.761385 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 85/174] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:05 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1511 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:05.803934 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-903e5f9b-ead1-4127-bfc5-2ac1ebd7b1f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:05.805003 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-903e5f9b-ead1-4127-bfc5-2ac1ebd7b1f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:05.815320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-903e5f9b-ead1-4127-bfc5-2ac1ebd7b1f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.815320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-903e5f9b-ead1-4127-bfc5-2ac1ebd7b1f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.815530 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-903e5f9b-ead1-4127-bfc5-2ac1ebd7b1f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.815999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-903e5f9b-ead1-4127-bfc5-2ac1ebd7b1f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.979020 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-903e5f9b-ead1-4127-bfc5-2ac1ebd7b1f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:05.988711 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-903e5f9b-ead1-4127-bfc5-2ac1ebd7b1f4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.197913 Jul 28 04:00:05.989376 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 90/175] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:05 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:06.745572 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6c9943ab-b447-4f5e-b61d-850065f971ad tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Action: 'create', calling method: .version_select at 0x7f55782d3550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1834974013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNm1QKxQVopYHNzQXnDRsZFOM7dtmWZjEXHp24ZSsVTX/ORfNM0S85DWeIvJhev+nj0rbkIf+Stw3o+W36sWpo75Rfl+5dmHgd0M7Ubzq2bzFfYc9LMtViJr8uCykmxQ=="}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:06.764158 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-6c9943ab-b447-4f5e-b61d-850065f971ad tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Getting quotas for project 5e16f8abc2ed4df1b2834b1669b67a1b. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:00:06.769576 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-6c9943ab-b447-4f5e-b61d-850065f971ad tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Getting quotas for user efddbdbab2724260a3efd7d01fc39bed and project 5e16f8abc2ed4df1b2834b1669b67a1b. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:00:06.774574 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:06.775746 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:06.784192 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.784192 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.784955 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.785409 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.818124 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.818733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.819783 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lazy-loading 'fault' on Instance uuid 29b7a8cc-247d-4e90-9d62-20d9198f0d00 {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:00:06.856260 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6c9943ab-b447-4f5e-b61d-850065f971ad tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.320017 Jul 28 04:00:06.857048 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 86/176] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 04:00:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:06.878144 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4c725ac09419db89121b72da41eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3d84518f1e4d7885f6998c88c3da4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:06.889599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c2e3a4d7-9e23-4981-a15a-b1d9fa21a736 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 200 len: 1351 microversion: 2.1 time: 0.120807 Jul 28 04:00:06.898666 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 91/177] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:06 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 1351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:07.016977 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-bf267c78-c09f-4010-becc-eda9c3d503cf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:07.017907 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-bf267c78-c09f-4010-becc-eda9c3d503cf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:07.025862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf267c78-c09f-4010-becc-eda9c3d503cf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.026490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf267c78-c09f-4010-becc-eda9c3d503cf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.029107 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf267c78-c09f-4010-becc-eda9c3d503cf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.029107 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bf267c78-c09f-4010-becc-eda9c3d503cf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.187197 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bf267c78-c09f-4010-becc-eda9c3d503cf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:07.196841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-bf267c78-c09f-4010-becc-eda9c3d503cf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.186353 Jul 28 04:00:07.198551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 87/178] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:07 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:07.915526 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:07.916243 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:07.927537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.927537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.927537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.927537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.946625 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] HTTP exception thrown: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Request method failure captured: Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 HTTP/1.1 Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGSrpHh9P7GKhJcp_1GqvsW82sJFBQJsQLNsszyU4TK9RQmM27ZqCgLh800GbMzy5heJgLQiSOFN4d6PU3tKb5NkkjCqqE1unvO1eIf6E_VgioP6RCvWWXAktwDgnE4-8aNOgst4Z-Zmj84-w6bXEWu-MQsnW5iQkrTp7qNgVDIWM Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 5c3d84518f1e4d7885f6998c88c3da4a Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:00:07.953086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c3d84518f1e4d7885f6998c88c3da4a", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c3d84518f1e4d7885f6998c88c3da4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c3d84518f1e4d7885f6998c88c3da4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c3d84518f1e4d7885f6998c88c3da4a"}]}] Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 5c3d84518f1e4d7885f6998c88c3da4a Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-DeleteServersTestJSON-297365928-project Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 35d4c725ac09419db89121b72da41eec Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-DeleteServersTestJSON-297365928-project Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:07.954352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '29b7a8cc-247d-4e90-9d62-20d9198f0d00'} Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:07.955024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:07.956156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.959185 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Returning 404 to user: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:07.959185 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-524bc43d-8b71-410c-8183-aece5ee6255c tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 404 len: 111 microversion: 2.1 time: 0.043893 Jul 28 04:00:07.969789 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 92/179] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:07 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:00:08.088665 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:08.091509 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:08.099029 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.102330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.102330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.102330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.117559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] HTTP exception thrown: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Request method failure captured: Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00/os-volume_attachments HTTP/1.1 Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmGSrpHh9P7GKhJcp_1GqvsW82sJFBQJsQLNsszyU4TK9RQmM27ZqCgLh800GbMzy5heJgLQiSOFN4d6PU3tKb5NkkjCqqE1unvO1eIf6E_VgioP6RCvWWXAktwDgnE4-8aNOgst4Z-Zmj84-w6bXEWu-MQsnW5iQkrTp7qNgVDIWM Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 5c3d84518f1e4d7885f6998c88c3da4a Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:00:08.122699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c3d84518f1e4d7885f6998c88c3da4a", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c3d84518f1e4d7885f6998c88c3da4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c3d84518f1e4d7885f6998c88c3da4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c3d84518f1e4d7885f6998c88c3da4a"}]}] Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 5c3d84518f1e4d7885f6998c88c3da4a Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-DeleteServersTestJSON-297365928-project Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 35d4c725ac09419db89121b72da41eec Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-DeleteServersTestJSON-297365928-project Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:08.128992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'server_id': '29b7a8cc-247d-4e90-9d62-20d9198f0d00'} Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:08.130136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:08.132285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.133568 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Returning 404 to user: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:08.133568 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-204c4221-6400-4ed3-906d-8d18029b6861 tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040862 Jul 28 04:00:08.140148 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 88/180] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:00:08 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:08.220385 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-44864843-6427-4348-898f-60cad5e12db5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:08.220922 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-44864843-6427-4348-898f-60cad5e12db5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:08.228987 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44864843-6427-4348-898f-60cad5e12db5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.229486 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44864843-6427-4348-898f-60cad5e12db5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.230257 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44864843-6427-4348-898f-60cad5e12db5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.230695 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44864843-6427-4348-898f-60cad5e12db5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.431298 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-44864843-6427-4348-898f-60cad5e12db5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:08.456624 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-44864843-6427-4348-898f-60cad5e12db5 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.240222 Jul 28 04:00:08.457785 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 93/181] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:08 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:09.481420 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-004db7ff-6ae1-49f7-bfc3-ec3b8f2e75d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.482059 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-004db7ff-6ae1-49f7-bfc3-ec3b8f2e75d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:09.488987 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-004db7ff-6ae1-49f7-bfc3-ec3b8f2e75d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.489449 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-004db7ff-6ae1-49f7-bfc3-ec3b8f2e75d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.490277 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-004db7ff-6ae1-49f7-bfc3-ec3b8f2e75d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.491452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-004db7ff-6ae1-49f7-bfc3-ec3b8f2e75d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.560958 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.568294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:09.583835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.591020 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.595840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.596878 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.613959 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] HTTP exception thrown: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Request method failure captured: Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: DELETE /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 HTTP/1.1 Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGSrpHh9P7GKhJcp_1GqvsW82sJFBQJsQLNsszyU4TK9RQmM27ZqCgLh800GbMzy5heJgLQiSOFN4d6PU3tKb5NkkjCqqE1unvO1eIf6E_VgioP6RCvWWXAktwDgnE4-8aNOgst4Z-Zmj84-w6bXEWu-MQsnW5iQkrTp7qNgVDIWM Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 5c3d84518f1e4d7885f6998c88c3da4a Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:00:09.615536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c3d84518f1e4d7885f6998c88c3da4a", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c3d84518f1e4d7885f6998c88c3da4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c3d84518f1e4d7885f6998c88c3da4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c3d84518f1e4d7885f6998c88c3da4a"}]}] Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 5c3d84518f1e4d7885f6998c88c3da4a Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-DeleteServersTestJSON-297365928-project Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 35d4c725ac09419db89121b72da41eec Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-DeleteServersTestJSON-297365928-project Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.617345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '29b7a8cc-247d-4e90-9d62-20d9198f0d00'} Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:09.618110 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.619215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.621549 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Returning 404 to user: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:09.622847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2279d57a-8169-4159-a34b-d0abc72d381a tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "DELETE /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 404 len: 111 microversion: 2.1 time: 0.071788 Jul 28 04:00:09.623417 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 94/182] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:00:09 2022] DELETE /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:00:09.633220 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.634357 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] [instance: 29b7a8cc-247d-4e90-9d62-20d9198f0d00] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:09.649063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.649063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.649063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.649063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.664307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] HTTP exception thrown: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Request method failure captured: Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 HTTP/1.1 Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGSrpHh9P7GKhJcp_1GqvsW82sJFBQJsQLNsszyU4TK9RQmM27ZqCgLh800GbMzy5heJgLQiSOFN4d6PU3tKb5NkkjCqqE1unvO1eIf6E_VgioP6RCvWWXAktwDgnE4-8aNOgst4Z-Zmj84-w6bXEWu-MQsnW5iQkrTp7qNgVDIWM Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 5c3d84518f1e4d7885f6998c88c3da4a Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:00:09.665846 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c3d84518f1e4d7885f6998c88c3da4a", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c3d84518f1e4d7885f6998c88c3da4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c3d84518f1e4d7885f6998c88c3da4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c3d84518f1e4d7885f6998c88c3da4a"}]}] Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 5c3d84518f1e4d7885f6998c88c3da4a Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-DeleteServersTestJSON-297365928 Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-DeleteServersTestJSON-297365928-project Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 35d4c725ac09419db89121b72da41eec Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-DeleteServersTestJSON-297365928-project Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.667301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '29b7a8cc-247d-4e90-9d62-20d9198f0d00'} Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:09.668114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. Jul 28 04:00:09.669307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.670412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] Returning 404 to user: Instance 29b7a8cc-247d-4e90-9d62-20d9198f0d00 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:09.670412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3ccca38e-2f4b-4031-a2ce-cabfab08d21e tempest-DeleteServersTestJSON-297365928 tempest-DeleteServersTestJSON-297365928-project] 10.222.0.66 "GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00" status: 404 len: 111 microversion: 2.1 time: 0.039672 Jul 28 04:00:09.671545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 95/183] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:09 2022] GET /compute/v2.1/servers/29b7a8cc-247d-4e90-9d62-20d9198f0d00 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:00:09.722770 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-004db7ff-6ae1-49f7-bfc3-ec3b8f2e75d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:09.741727 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-004db7ff-6ae1-49f7-bfc3-ec3b8f2e75d0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.263344 Jul 28 04:00:09.742491 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 89/184] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:09 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:10.767855 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ee50b20a-d89c-41f0-a3c7-305f4f32f608 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.768583 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ee50b20a-d89c-41f0-a3c7-305f4f32f608 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:10.771574 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=76 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:10.779731 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ee50b20a-d89c-41f0-a3c7-305f4f32f608 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.780243 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ee50b20a-d89c-41f0-a3c7-305f4f32f608 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.781044 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ee50b20a-d89c-41f0-a3c7-305f4f32f608 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.781495 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ee50b20a-d89c-41f0-a3c7-305f4f32f608 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:11.031045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ee50b20a-d89c-41f0-a3c7-305f4f32f608 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:11.039496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ee50b20a-d89c-41f0-a3c7-305f4f32f608 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.279655 Jul 28 04:00:11.040112 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 96/185] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:10 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:12.063413 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ad5d0cdb-fd4a-42f0-b212-3dd9ee19d668 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:12.064140 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ad5d0cdb-fd4a-42f0-b212-3dd9ee19d668 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:12.076158 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ad5d0cdb-fd4a-42f0-b212-3dd9ee19d668 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.076659 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ad5d0cdb-fd4a-42f0-b212-3dd9ee19d668 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.077916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ad5d0cdb-fd4a-42f0-b212-3dd9ee19d668 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.078454 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ad5d0cdb-fd4a-42f0-b212-3dd9ee19d668 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.227869 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ad5d0cdb-fd4a-42f0-b212-3dd9ee19d668 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:12.236342 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ad5d0cdb-fd4a-42f0-b212-3dd9ee19d668 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.176713 Jul 28 04:00:12.237742 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 90/186] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:12 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:13.261497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ec7a60ad-878f-4e4b-88b3-09b730ebe5f6 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:13.262663 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ec7a60ad-878f-4e4b-88b3-09b730ebe5f6 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:13.278355 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ec7a60ad-878f-4e4b-88b3-09b730ebe5f6 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:13.278829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ec7a60ad-878f-4e4b-88b3-09b730ebe5f6 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:13.287312 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ec7a60ad-878f-4e4b-88b3-09b730ebe5f6 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:13.287312 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ec7a60ad-878f-4e4b-88b3-09b730ebe5f6 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:13.485537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ec7a60ad-878f-4e4b-88b3-09b730ebe5f6 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:13.494372 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ec7a60ad-878f-4e4b-88b3-09b730ebe5f6 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.236813 Jul 28 04:00:13.495546 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 97/187] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:13 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:14.516283 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4e2a3f44-5237-47d4-a32a-90c5830af371 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:14.516896 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4e2a3f44-5237-47d4-a32a-90c5830af371 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:14.522934 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4e2a3f44-5237-47d4-a32a-90c5830af371 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.523393 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4e2a3f44-5237-47d4-a32a-90c5830af371 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:14.524210 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4e2a3f44-5237-47d4-a32a-90c5830af371 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.524654 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4e2a3f44-5237-47d4-a32a-90c5830af371 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:14.661743 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4e2a3f44-5237-47d4-a32a-90c5830af371 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:14.670188 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4e2a3f44-5237-47d4-a32a-90c5830af371 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.157776 Jul 28 04:00:14.670772 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 91/188] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:14 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:15.692179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8b51f23b-205a-4714-acfb-4d316ca6df39 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:15.692821 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8b51f23b-205a-4714-acfb-4d316ca6df39 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:15.699932 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8b51f23b-205a-4714-acfb-4d316ca6df39 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:15.700428 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8b51f23b-205a-4714-acfb-4d316ca6df39 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.701253 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8b51f23b-205a-4714-acfb-4d316ca6df39 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:15.701703 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8b51f23b-205a-4714-acfb-4d316ca6df39 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.842544 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8b51f23b-205a-4714-acfb-4d316ca6df39 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:15.851595 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8b51f23b-205a-4714-acfb-4d316ca6df39 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.162776 Jul 28 04:00:15.852518 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 98/189] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:15 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:16.873517 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5479d726-96ba-437d-b15d-76ecd0a86d07 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:16.874136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5479d726-96ba-437d-b15d-76ecd0a86d07 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:16.876066 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=4 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:16.881694 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5479d726-96ba-437d-b15d-76ecd0a86d07 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.882242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5479d726-96ba-437d-b15d-76ecd0a86d07 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.883023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5479d726-96ba-437d-b15d-76ecd0a86d07 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.883462 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5479d726-96ba-437d-b15d-76ecd0a86d07 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:17.020984 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5479d726-96ba-437d-b15d-76ecd0a86d07 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:17.029438 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5479d726-96ba-437d-b15d-76ecd0a86d07 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.159935 Jul 28 04:00:17.030005 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 92/190] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:16 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:18.050180 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fe16a920-2460-4e13-8ea2-ce8732801d1f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:18.050711 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fe16a920-2460-4e13-8ea2-ce8732801d1f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:18.057888 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fe16a920-2460-4e13-8ea2-ce8732801d1f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:18.058344 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fe16a920-2460-4e13-8ea2-ce8732801d1f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:18.059106 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fe16a920-2460-4e13-8ea2-ce8732801d1f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:18.059738 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fe16a920-2460-4e13-8ea2-ce8732801d1f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:18.193619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fe16a920-2460-4e13-8ea2-ce8732801d1f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:18.201778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fe16a920-2460-4e13-8ea2-ce8732801d1f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.155425 Jul 28 04:00:18.202343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 99/191] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:18 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:19.222035 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e8a8e7b8-3676-403c-8a05-ecdf28b5736f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:19.222645 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e8a8e7b8-3676-403c-8a05-ecdf28b5736f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:19.224521 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:19.229285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e8a8e7b8-3676-403c-8a05-ecdf28b5736f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.229731 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e8a8e7b8-3676-403c-8a05-ecdf28b5736f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.230483 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e8a8e7b8-3676-403c-8a05-ecdf28b5736f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.230917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e8a8e7b8-3676-403c-8a05-ecdf28b5736f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.361008 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e8a8e7b8-3676-403c-8a05-ecdf28b5736f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:19.369286 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e8a8e7b8-3676-403c-8a05-ecdf28b5736f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.151074 Jul 28 04:00:19.369865 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 93/192] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:19 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:20.392771 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-29eeeb32-a458-4364-adcd-3d251e2c34e0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:20.393377 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-29eeeb32-a458-4364-adcd-3d251e2c34e0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:20.400221 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-29eeeb32-a458-4364-adcd-3d251e2c34e0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.400679 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-29eeeb32-a458-4364-adcd-3d251e2c34e0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:20.401465 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-29eeeb32-a458-4364-adcd-3d251e2c34e0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.401902 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-29eeeb32-a458-4364-adcd-3d251e2c34e0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:20.550800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-29eeeb32-a458-4364-adcd-3d251e2c34e0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:20.559657 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-29eeeb32-a458-4364-adcd-3d251e2c34e0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.172432 Jul 28 04:00:20.560273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 100/193] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:20 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:21.582113 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-cc33c26c-0b30-421d-9899-a2f4f2f18828 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:21.582847 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-cc33c26c-0b30-421d-9899-a2f4f2f18828 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:21.590912 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cc33c26c-0b30-421d-9899-a2f4f2f18828 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:21.591362 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cc33c26c-0b30-421d-9899-a2f4f2f18828 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:21.592163 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cc33c26c-0b30-421d-9899-a2f4f2f18828 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:21.592600 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cc33c26c-0b30-421d-9899-a2f4f2f18828 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:21.738015 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cc33c26c-0b30-421d-9899-a2f4f2f18828 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:21.746200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-cc33c26c-0b30-421d-9899-a2f4f2f18828 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.168674 Jul 28 04:00:21.746784 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 94/194] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:21 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:22.781055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-20ae85f3-a6c8-492e-827a-43b82b37bcdc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:22.781673 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-20ae85f3-a6c8-492e-827a-43b82b37bcdc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:22.788805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-20ae85f3-a6c8-492e-827a-43b82b37bcdc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:22.789367 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-20ae85f3-a6c8-492e-827a-43b82b37bcdc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:22.790149 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-20ae85f3-a6c8-492e-827a-43b82b37bcdc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:22.790599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-20ae85f3-a6c8-492e-827a-43b82b37bcdc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:22.921376 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-20ae85f3-a6c8-492e-827a-43b82b37bcdc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:22.929662 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-20ae85f3-a6c8-492e-827a-43b82b37bcdc tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.152445 Jul 28 04:00:22.930213 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 101/195] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:22 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:23.951444 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1a971f06-db14-4e22-9c1d-b1b875abc452 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:23.952104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1a971f06-db14-4e22-9c1d-b1b875abc452 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:23.958176 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1a971f06-db14-4e22-9c1d-b1b875abc452 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.958619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1a971f06-db14-4e22-9c1d-b1b875abc452 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:23.959386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1a971f06-db14-4e22-9c1d-b1b875abc452 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.959883 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1a971f06-db14-4e22-9c1d-b1b875abc452 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:24.090523 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1a971f06-db14-4e22-9c1d-b1b875abc452 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:24.098118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1a971f06-db14-4e22-9c1d-b1b875abc452 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.150896 Jul 28 04:00:24.098697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 95/196] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:23 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:25.122980 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c0d48bf3-49a7-4278-b08e-7a1d7913f86e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:25.123741 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c0d48bf3-49a7-4278-b08e-7a1d7913f86e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:25.130357 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c0d48bf3-49a7-4278-b08e-7a1d7913f86e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:25.131596 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c0d48bf3-49a7-4278-b08e-7a1d7913f86e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:25.131596 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c0d48bf3-49a7-4278-b08e-7a1d7913f86e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:25.132296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c0d48bf3-49a7-4278-b08e-7a1d7913f86e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:25.265566 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c0d48bf3-49a7-4278-b08e-7a1d7913f86e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:25.273816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c0d48bf3-49a7-4278-b08e-7a1d7913f86e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.154947 Jul 28 04:00:25.274391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 102/197] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:25 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:26.295415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a74295b8-ac0c-48c9-8ff3-ce1741a5fb22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:26.296497 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a74295b8-ac0c-48c9-8ff3-ce1741a5fb22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:26.304440 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a74295b8-ac0c-48c9-8ff3-ce1741a5fb22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:26.304899 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a74295b8-ac0c-48c9-8ff3-ce1741a5fb22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:26.305861 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a74295b8-ac0c-48c9-8ff3-ce1741a5fb22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:26.306308 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a74295b8-ac0c-48c9-8ff3-ce1741a5fb22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:26.446310 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a74295b8-ac0c-48c9-8ff3-ce1741a5fb22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:26.454090 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a74295b8-ac0c-48c9-8ff3-ce1741a5fb22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.162528 Jul 28 04:00:26.454659 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 96/198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:26 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:27.474616 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-812ba067-1bb5-4102-bbe8-3e77f16beeaa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:27.475239 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-812ba067-1bb5-4102-bbe8-3e77f16beeaa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:27.482125 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-812ba067-1bb5-4102-bbe8-3e77f16beeaa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.482576 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-812ba067-1bb5-4102-bbe8-3e77f16beeaa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.483368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-812ba067-1bb5-4102-bbe8-3e77f16beeaa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.483820 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-812ba067-1bb5-4102-bbe8-3e77f16beeaa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.627341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-812ba067-1bb5-4102-bbe8-3e77f16beeaa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:27.638091 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-812ba067-1bb5-4102-bbe8-3e77f16beeaa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.167245 Jul 28 04:00:27.638914 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 103/199] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:27 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:28.663540 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-76cd40af-1c8c-402c-8305-c58fbf80ded2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:28.664407 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-76cd40af-1c8c-402c-8305-c58fbf80ded2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:28.671376 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76cd40af-1c8c-402c-8305-c58fbf80ded2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:28.671827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76cd40af-1c8c-402c-8305-c58fbf80ded2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:28.672628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76cd40af-1c8c-402c-8305-c58fbf80ded2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:28.673074 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76cd40af-1c8c-402c-8305-c58fbf80ded2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:28.877094 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-76cd40af-1c8c-402c-8305-c58fbf80ded2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:28.885414 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-76cd40af-1c8c-402c-8305-c58fbf80ded2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.226124 Jul 28 04:00:28.885991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 97/200] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:28 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:29.915170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9e7f77d2-6af4-4e91-a782-bffd4bfcabe3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:29.915848 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9e7f77d2-6af4-4e91-a782-bffd4bfcabe3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:29.922991 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9e7f77d2-6af4-4e91-a782-bffd4bfcabe3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:29.923471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9e7f77d2-6af4-4e91-a782-bffd4bfcabe3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:29.924280 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9e7f77d2-6af4-4e91-a782-bffd4bfcabe3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:29.924728 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9e7f77d2-6af4-4e91-a782-bffd4bfcabe3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:29.944448 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=100 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:30.102314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9e7f77d2-6af4-4e91-a782-bffd4bfcabe3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:30.111615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9e7f77d2-6af4-4e91-a782-bffd4bfcabe3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.206040 Jul 28 04:00:30.112241 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 104/201] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:29 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:31.132838 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5e3dba29-1bda-40c8-9486-8119d7f70545 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:31.133801 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5e3dba29-1bda-40c8-9486-8119d7f70545 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:31.140845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e3dba29-1bda-40c8-9486-8119d7f70545 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:31.141396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e3dba29-1bda-40c8-9486-8119d7f70545 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:31.142207 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e3dba29-1bda-40c8-9486-8119d7f70545 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:31.142651 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e3dba29-1bda-40c8-9486-8119d7f70545 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:31.294273 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5e3dba29-1bda-40c8-9486-8119d7f70545 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:31.304097 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5e3dba29-1bda-40c8-9486-8119d7f70545 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1522 microversion: 2.1 time: 0.175040 Jul 28 04:00:31.305945 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 98/202] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:31 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:32.327042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-14c63342-b7fd-41ce-b2e4-0c3b6b2e2331 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:32.327660 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-14c63342-b7fd-41ce-b2e4-0c3b6b2e2331 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:32.334354 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-14c63342-b7fd-41ce-b2e4-0c3b6b2e2331 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:32.335204 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-14c63342-b7fd-41ce-b2e4-0c3b6b2e2331 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:32.335645 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-14c63342-b7fd-41ce-b2e4-0c3b6b2e2331 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:32.336393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-14c63342-b7fd-41ce-b2e4-0c3b6b2e2331 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:32.510143 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-14c63342-b7fd-41ce-b2e4-0c3b6b2e2331 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:32.517926 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-14c63342-b7fd-41ce-b2e4-0c3b6b2e2331 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1502 microversion: 2.1 time: 0.194686 Jul 28 04:00:32.532868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 105/203] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:32 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:32.544717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-abd702c6-c9bc-4234-adcd-fb953f691f93 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:32.545335 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-abd702c6-c9bc-4234-adcd-fb953f691f93 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:32.553337 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-abd702c6-c9bc-4234-adcd-fb953f691f93 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:32.553787 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-abd702c6-c9bc-4234-adcd-fb953f691f93 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:32.555226 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-abd702c6-c9bc-4234-adcd-fb953f691f93 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:32.555725 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-abd702c6-c9bc-4234-adcd-fb953f691f93 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:32.765440 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-abd702c6-c9bc-4234-adcd-fb953f691f93 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:32.774654 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-abd702c6-c9bc-4234-adcd-fb953f691f93 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1515 microversion: 2.1 time: 0.234050 Jul 28 04:00:32.775498 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 99/204] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:32 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:34.664315 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-567b238d-972f-497d-b629-55b1a32376ea tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:34.666584 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-567b238d-972f-497d-b629-55b1a32376ea tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:34.673207 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-567b238d-972f-497d-b629-55b1a32376ea tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:34.673663 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-567b238d-972f-497d-b629-55b1a32376ea tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:34.674425 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-567b238d-972f-497d-b629-55b1a32376ea tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:34.674866 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-567b238d-972f-497d-b629-55b1a32376ea tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:34.699070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-567b238d-972f-497d-b629-55b1a32376ea tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lazy-loading 'flavor' on Instance uuid a30f5c60-8ee4-4d46-aec9-34dd464d21b9 {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:00:35.062129 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-567b238d-972f-497d-b629-55b1a32376ea tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9/action" status: 200 len: 32 microversion: 2.1 time: 0.402318 Jul 28 04:00:35.062841 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 106/205] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:00:34 2022] POST /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:00:35.073998 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ae6a96a0-0223-462c-876e-631c28b2bd9d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:35.073998 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ae6a96a0-0223-462c-876e-631c28b2bd9d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:35.079333 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ae6a96a0-0223-462c-876e-631c28b2bd9d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:35.079791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ae6a96a0-0223-462c-876e-631c28b2bd9d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:35.080618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ae6a96a0-0223-462c-876e-631c28b2bd9d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:35.081092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ae6a96a0-0223-462c-876e-631c28b2bd9d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:35.252643 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ae6a96a0-0223-462c-876e-631c28b2bd9d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:35.269389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ae6a96a0-0223-462c-876e-631c28b2bd9d tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.200231 Jul 28 04:00:35.272253 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 100/206] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:35 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:36.238440 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1678547148", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:36.291916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e32f6394-e922-45f5-b4ec-164019a8cb35 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:36.292570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e32f6394-e922-45f5-b4ec-164019a8cb35 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:36.296951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] validate_networks() for None {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:00:36.298835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e32f6394-e922-45f5-b4ec-164019a8cb35 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:36.299280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e32f6394-e922-45f5-b4ec-164019a8cb35 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:36.300074 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e32f6394-e922-45f5-b4ec-164019a8cb35 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:36.300511 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e32f6394-e922-45f5-b4ec-164019a8cb35 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:36.303092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=91 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:36.455646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e32f6394-e922-45f5-b4ec-164019a8cb35 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:36.466490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e32f6394-e922-45f5-b4ec-164019a8cb35 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.178886 Jul 28 04:00:36.468113 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 101/207] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:36 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:36.623704 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:00:36.624180 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:00:36.624664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:00:36.625119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:00:36.625542 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:00:36.635738 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:36.636240 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:36.637056 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:36.637505 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:36.657948 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Getting quotas for project 3703ddd7285740f593e7269eac250ebc. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:00:36.662189 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Getting quotas for user 619ca9e08af84d8cb43de592027c90f6 and project 3703ddd7285740f593e7269eac250ebc. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:00:36.675125 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:00:36.677585 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:00:36.839456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3370b819-aca7-4101-8e57-906c8361b50e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605832 Jul 28 04:00:36.850219 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 107/208] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:00:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:00:36.857937 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f3dc128a-66be-4a4e-b2d8-0fed0bbf0270 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:36.858927 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f3dc128a-66be-4a4e-b2d8-0fed0bbf0270 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:36.914693 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f3dc128a-66be-4a4e-b2d8-0fed0bbf0270 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:36.922584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f3dc128a-66be-4a4e-b2d8-0fed0bbf0270 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1215 microversion: 2.1 time: 0.071118 Jul 28 04:00:36.935486 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 102/209] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:36 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:37.487236 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a054261e-5f8e-4528-ab73-544721e7e0c2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:37.490934 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a054261e-5f8e-4528-ab73-544721e7e0c2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:37.495875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a054261e-5f8e-4528-ab73-544721e7e0c2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:37.496366 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a054261e-5f8e-4528-ab73-544721e7e0c2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:37.497152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a054261e-5f8e-4528-ab73-544721e7e0c2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:37.497851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a054261e-5f8e-4528-ab73-544721e7e0c2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:37.826177 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a054261e-5f8e-4528-ab73-544721e7e0c2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:37.833708 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a054261e-5f8e-4528-ab73-544721e7e0c2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.350787 Jul 28 04:00:37.834482 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 108/210] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:37 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:37.943844 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6c4400c3-15b6-4fb1-88b3-2e1d2fe19540 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:37.944561 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6c4400c3-15b6-4fb1-88b3-2e1d2fe19540 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:38.029255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6c4400c3-15b6-4fb1-88b3-2e1d2fe19540 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:38.037195 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6c4400c3-15b6-4fb1-88b3-2e1d2fe19540 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1215 microversion: 2.1 time: 0.097805 Jul 28 04:00:38.040154 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 103/211] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:37 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:38.861531 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-421f7710-9a73-4948-baa8-8c6aa4050a3c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:38.862482 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-421f7710-9a73-4948-baa8-8c6aa4050a3c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:38.872347 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-421f7710-9a73-4948-baa8-8c6aa4050a3c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:38.873060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-421f7710-9a73-4948-baa8-8c6aa4050a3c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:38.874021 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-421f7710-9a73-4948-baa8-8c6aa4050a3c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:38.874779 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-421f7710-9a73-4948-baa8-8c6aa4050a3c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.028510 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-421f7710-9a73-4948-baa8-8c6aa4050a3c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:39.036078 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-421f7710-9a73-4948-baa8-8c6aa4050a3c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.184934 Jul 28 04:00:39.042668 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 109/212] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:38 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:39.058557 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-24cc00c6-5635-486a-9ad9-c0b1b4d8d06e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:39.059157 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-24cc00c6-5635-486a-9ad9-c0b1b4d8d06e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:39.065444 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-24cc00c6-5635-486a-9ad9-c0b1b4d8d06e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.065897 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-24cc00c6-5635-486a-9ad9-c0b1b4d8d06e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.066670 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-24cc00c6-5635-486a-9ad9-c0b1b4d8d06e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.067107 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-24cc00c6-5635-486a-9ad9-c0b1b4d8d06e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.130050 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-24cc00c6-5635-486a-9ad9-c0b1b4d8d06e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:39.137604 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-24cc00c6-5635-486a-9ad9-c0b1b4d8d06e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1267 microversion: 2.1 time: 0.083485 Jul 28 04:00:39.138165 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 104/213] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:39 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:39.729939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-627517183", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1834974013", "security_groups": [{"name": "tempest-secgroup-smoke-780248956"}], "networks": [{"uuid": "577751dd-78a4-42c8-b90a-c6d300b531a2"}], "block_device_mapping_v2": [{"uuid": "33fdb90d-e183-4304-afd7-2c5541533438", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:39.866103 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] validate_networks() for [('577751dd-78a4-42c8-b90a-c6d300b531a2', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:00:40.063118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a044ba75-da41-40c5-ba2e-09d36d1beef2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:40.067125 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a044ba75-da41-40c5-ba2e-09d36d1beef2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:40.075139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a044ba75-da41-40c5-ba2e-09d36d1beef2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.075782 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a044ba75-da41-40c5-ba2e-09d36d1beef2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.076948 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a044ba75-da41-40c5-ba2e-09d36d1beef2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.077543 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a044ba75-da41-40c5-ba2e-09d36d1beef2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.260322 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a044ba75-da41-40c5-ba2e-09d36d1beef2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:40.268105 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a044ba75-da41-40c5-ba2e-09d36d1beef2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.215227 Jul 28 04:00:40.268983 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 105/214] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:40 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:40.288498 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f783741f-917c-4b81-b1c2-6262d94a1c7b tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:40.290327 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f783741f-917c-4b81-b1c2-6262d94a1c7b tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:40.297569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f783741f-917c-4b81-b1c2-6262d94a1c7b tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.298988 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f783741f-917c-4b81-b1c2-6262d94a1c7b tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.298988 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f783741f-917c-4b81-b1c2-6262d94a1c7b tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.299312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f783741f-917c-4b81-b1c2-6262d94a1c7b tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.306481 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:00:40.307162 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:00:40.307787 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:00:40.308340 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:00:40.308891 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:00:40.319785 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.321368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.322884 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.323334 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.345538 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Getting quotas for project 5e16f8abc2ed4df1b2834b1669b67a1b. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:00:40.349767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Getting quotas for user efddbdbab2724260a3efd7d01fc39bed and project 5e16f8abc2ed4df1b2834b1669b67a1b. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:00:40.415331 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:00:40.418145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33fdb90d-e183-4304-afd7-2c5541533438',volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:00:40.439135 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f783741f-917c-4b81-b1c2-6262d94a1c7b tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:40.455107 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f783741f-917c-4b81-b1c2-6262d94a1c7b tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1273 microversion: 2.1 time: 0.173528 Jul 28 04:00:40.455710 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 106/215] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:40 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:40.876019 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-757662088", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "networks": [{"uuid": "4b26df26-f527-4a68-b490-7db3cb955d7b"}]}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:40.897715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-21333e17-27f8-44c1-8175-b16a62e7dd14 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.172575 Jul 28 04:00:40.921526 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 110/216] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:00:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:00:40.930376 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fa54f9da-9cf9-4cf1-87fb-134cbceb8124 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:40.931548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fa54f9da-9cf9-4cf1-87fb-134cbceb8124 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:40.974559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.network.neutron [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] validate_networks() for [('4b26df26-f527-4a68-b490-7db3cb955d7b', None, None, None, None, None)] {{(pid=135704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:00:41.000359 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fa54f9da-9cf9-4cf1-87fb-134cbceb8124 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:41.009686 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fa54f9da-9cf9-4cf1-87fb-134cbceb8124 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1088 microversion: 2.1 time: 0.088125 Jul 28 04:00:41.011596 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 111/217] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:40 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1088 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:41.295464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0446ca77-bd2c-4243-bc72-250a775e3317 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:41.296321 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0446ca77-bd2c-4243-bc72-250a775e3317 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:41.298513 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:41.303653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0446ca77-bd2c-4243-bc72-250a775e3317 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.304152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0446ca77-bd2c-4243-bc72-250a775e3317 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.305489 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0446ca77-bd2c-4243-bc72-250a775e3317 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.305935 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0446ca77-bd2c-4243-bc72-250a775e3317 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.440276 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0446ca77-bd2c-4243-bc72-250a775e3317 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:41.448333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0446ca77-bd2c-4243-bc72-250a775e3317 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.156891 Jul 28 04:00:41.461622 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 112/218] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:41 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:41.478565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6effbdf0-0102-4f4d-813c-a55c6e2f7673 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:41.479303 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6effbdf0-0102-4f4d-813c-a55c6e2f7673 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:41.486211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6effbdf0-0102-4f4d-813c-a55c6e2f7673 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.487297 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6effbdf0-0102-4f4d-813c-a55c6e2f7673 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.487528 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6effbdf0-0102-4f4d-813c-a55c6e2f7673 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.488100 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6effbdf0-0102-4f4d-813c-a55c6e2f7673 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.595221 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Flavor limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:00:41.596232 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Image limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:00:41.596713 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Flavor pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:00:41.597285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Image pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:00:41.597706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:00:41.608793 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.609483 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.611203 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.612334 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.626341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6effbdf0-0102-4f4d-813c-a55c6e2f7673 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:41.633862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Getting quotas for project 7041d959d23d41c58ac1f68559a14647. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:00:41.635824 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6effbdf0-0102-4f4d-813c-a55c6e2f7673 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1315 microversion: 2.1 time: 0.161911 Jul 28 04:00:41.636662 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 113/219] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:41 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:41.638419 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Getting quotas for user dc5a6050226a4e03b027bc8006e90df6 and project 7041d959d23d41c58ac1f68559a14647. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:00:41.650770 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Going to run 1 instances... {{(pid=135704) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:00:41.653242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:00:41.809694 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-73cf32cc-5ba4-4af0-888b-3923b724d82f tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940049 Jul 28 04:00:41.810525 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 107/220] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:00:41.822327 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b1c70cc9-0278-44d6-b59f-a419bb0d586a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:41.823192 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b1c70cc9-0278-44d6-b59f-a419bb0d586a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:41.920356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b1c70cc9-0278-44d6-b59f-a419bb0d586a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:41.938283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b1c70cc9-0278-44d6-b59f-a419bb0d586a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1213 microversion: 2.1 time: 0.120688 Jul 28 04:00:41.940575 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 114/221] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:41 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:42.035320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-258936a7-bf16-42b1-8af7-27be9134514b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:42.036548 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-258936a7-bf16-42b1-8af7-27be9134514b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:42.119554 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-258936a7-bf16-42b1-8af7-27be9134514b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:42.127180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-258936a7-bf16-42b1-8af7-27be9134514b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1088 microversion: 2.1 time: 0.098814 Jul 28 04:00:42.127749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 108/222] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:42 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1088 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:42.223976 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-e5ffa0c6-dbdb-416c-9270-cd273f6337c6 req-07c59d6d-4bd5-4e32-ba9c-134cf85a4454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc05300-354f-45e2-b18d-208242b25442", "tag": "08a5cd31-ba92-4ee2-a0ac-9245a170d029"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:42.249880 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-e5ffa0c6-dbdb-416c-9270-cd273f6337c6 req-07c59d6d-4bd5-4e32-ba9c-134cf85a4454 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.250425 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-e5ffa0c6-dbdb-416c-9270-cd273f6337c6 req-07c59d6d-4bd5-4e32-ba9c-134cf85a4454 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.263159 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-e5ffa0c6-dbdb-416c-9270-cd273f6337c6 req-07c59d6d-4bd5-4e32-ba9c-134cf85a4454 service nova] Creating event network-changed:08a5cd31-ba92-4ee2-a0ac-9245a170d029 for instance 7fc05300-354f-45e2-b18d-208242b25442 on hv-cinder-85127 Jul 28 04:00:42.269348 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-e5ffa0c6-dbdb-416c-9270-cd273f6337c6 req-07c59d6d-4bd5-4e32-ba9c-134cf85a4454 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048884 Jul 28 04:00:42.270039 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 115/223] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:42.469704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c6e1ef4b-7103-43b4-88e0-7dbcd2918057 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:42.470500 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c6e1ef4b-7103-43b4-88e0-7dbcd2918057 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:42.478161 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c6e1ef4b-7103-43b4-88e0-7dbcd2918057 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.478876 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c6e1ef4b-7103-43b4-88e0-7dbcd2918057 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.479659 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c6e1ef4b-7103-43b4-88e0-7dbcd2918057 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.480136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c6e1ef4b-7103-43b4-88e0-7dbcd2918057 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.658159 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0a83afcc-c34a-464d-9d76-a75d1ed612b1 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:42.658873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0a83afcc-c34a-464d-9d76-a75d1ed612b1 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:42.666048 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0a83afcc-c34a-464d-9d76-a75d1ed612b1 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.666518 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0a83afcc-c34a-464d-9d76-a75d1ed612b1 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.667310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0a83afcc-c34a-464d-9d76-a75d1ed612b1 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.667760 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0a83afcc-c34a-464d-9d76-a75d1ed612b1 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.713311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c6e1ef4b-7103-43b4-88e0-7dbcd2918057 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:42.722130 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c6e1ef4b-7103-43b4-88e0-7dbcd2918057 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.256274 Jul 28 04:00:42.722718 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 109/224] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:42 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:42.818663 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0a83afcc-c34a-464d-9d76-a75d1ed612b1 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:42.828156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0a83afcc-c34a-464d-9d76-a75d1ed612b1 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1315 microversion: 2.1 time: 0.174462 Jul 28 04:00:42.828894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 116/225] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:42 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:42.961509 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d77fb8fc-0088-49b1-8725-2235da178b1c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:42.962114 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d77fb8fc-0088-49b1-8725-2235da178b1c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:43.053750 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d77fb8fc-0088-49b1-8725-2235da178b1c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:43.061705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d77fb8fc-0088-49b1-8725-2235da178b1c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1213 microversion: 2.1 time: 0.104176 Jul 28 04:00:43.062569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 110/226] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:42 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:43.148137 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0cf94127-29ec-4423-b30d-bd69bb94eb85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:43.149721 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0cf94127-29ec-4423-b30d-bd69bb94eb85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:43.160362 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cf94127-29ec-4423-b30d-bd69bb94eb85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.160821 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cf94127-29ec-4423-b30d-bd69bb94eb85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.161617 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cf94127-29ec-4423-b30d-bd69bb94eb85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.162065 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cf94127-29ec-4423-b30d-bd69bb94eb85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.228201 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0cf94127-29ec-4423-b30d-bd69bb94eb85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:43.236064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0cf94127-29ec-4423-b30d-bd69bb94eb85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1186 microversion: 2.1 time: 0.091941 Jul 28 04:00:43.236953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 117/227] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:43 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:43.745930 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-21ad9d55-6fde-4e4f-916e-e0a6948c58d4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:43.746628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-21ad9d55-6fde-4e4f-916e-e0a6948c58d4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:43.753182 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-21ad9d55-6fde-4e4f-916e-e0a6948c58d4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.753640 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-21ad9d55-6fde-4e4f-916e-e0a6948c58d4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.754408 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-21ad9d55-6fde-4e4f-916e-e0a6948c58d4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.754852 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-21ad9d55-6fde-4e4f-916e-e0a6948c58d4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.849813 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0e7ec5fb-4d15-40e8-88ea-c2bdfa6dcbd5 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:43.850651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0e7ec5fb-4d15-40e8-88ea-c2bdfa6dcbd5 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:43.857984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0e7ec5fb-4d15-40e8-88ea-c2bdfa6dcbd5 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.865036 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0e7ec5fb-4d15-40e8-88ea-c2bdfa6dcbd5 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.865036 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0e7ec5fb-4d15-40e8-88ea-c2bdfa6dcbd5 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.865036 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0e7ec5fb-4d15-40e8-88ea-c2bdfa6dcbd5 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.894237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-21ad9d55-6fde-4e4f-916e-e0a6948c58d4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:43.902718 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-21ad9d55-6fde-4e4f-916e-e0a6948c58d4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.160811 Jul 28 04:00:43.909932 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 111/228] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:43 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:43.993061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0e7ec5fb-4d15-40e8-88ea-c2bdfa6dcbd5 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:44.001299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0e7ec5fb-4d15-40e8-88ea-c2bdfa6dcbd5 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1315 microversion: 2.1 time: 0.155049 Jul 28 04:00:44.001299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 118/229] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:43 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:44.084016 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3bd64352-7741-4afe-89cb-2e12bf738a3e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:44.084662 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3bd64352-7741-4afe-89cb-2e12bf738a3e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:44.091387 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3bd64352-7741-4afe-89cb-2e12bf738a3e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.091853 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3bd64352-7741-4afe-89cb-2e12bf738a3e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.092679 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3bd64352-7741-4afe-89cb-2e12bf738a3e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.093120 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3bd64352-7741-4afe-89cb-2e12bf738a3e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.152857 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-3bd64352-7741-4afe-89cb-2e12bf738a3e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:44.160295 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3bd64352-7741-4afe-89cb-2e12bf738a3e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1217 microversion: 2.1 time: 0.080840 Jul 28 04:00:44.160868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 112/230] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:44 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:44.260343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6f581a02-d65b-4f07-a922-39ff03a1884b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:44.261042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6f581a02-d65b-4f07-a922-39ff03a1884b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:44.267709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6f581a02-d65b-4f07-a922-39ff03a1884b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.268206 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6f581a02-d65b-4f07-a922-39ff03a1884b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.268999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6f581a02-d65b-4f07-a922-39ff03a1884b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.269448 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6f581a02-d65b-4f07-a922-39ff03a1884b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.336546 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6f581a02-d65b-4f07-a922-39ff03a1884b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:44.344363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6f581a02-d65b-4f07-a922-39ff03a1884b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1194 microversion: 2.1 time: 0.088514 Jul 28 04:00:44.345171 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 119/231] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:44 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:44.924604 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-19b32faf-29fe-4197-b902-a983b377fe03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:44.925216 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-19b32faf-29fe-4197-b902-a983b377fe03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:44.933196 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-19b32faf-29fe-4197-b902-a983b377fe03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.933665 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-19b32faf-29fe-4197-b902-a983b377fe03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.934435 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-19b32faf-29fe-4197-b902-a983b377fe03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.934876 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-19b32faf-29fe-4197-b902-a983b377fe03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.022651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-30137e82-eb10-40a7-9634-56dd458e54c4 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:45.024849 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-30137e82-eb10-40a7-9634-56dd458e54c4 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:45.030551 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-30137e82-eb10-40a7-9634-56dd458e54c4 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.031100 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-30137e82-eb10-40a7-9634-56dd458e54c4 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.032003 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-30137e82-eb10-40a7-9634-56dd458e54c4 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.032688 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-30137e82-eb10-40a7-9634-56dd458e54c4 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.154346 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-19b32faf-29fe-4197-b902-a983b377fe03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:45.169960 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-19b32faf-29fe-4197-b902-a983b377fe03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.242818 Jul 28 04:00:45.169960 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 113/232] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:44 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:45.185537 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-40aa843b-6ea6-455b-a84b-6bde9a9c067d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:45.187358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-40aa843b-6ea6-455b-a84b-6bde9a9c067d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:45.194761 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-40aa843b-6ea6-455b-a84b-6bde9a9c067d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.202681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-40aa843b-6ea6-455b-a84b-6bde9a9c067d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.202681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-40aa843b-6ea6-455b-a84b-6bde9a9c067d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.202681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-40aa843b-6ea6-455b-a84b-6bde9a9c067d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.203666 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-30137e82-eb10-40a7-9634-56dd458e54c4 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:45.214332 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-30137e82-eb10-40a7-9634-56dd458e54c4 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1315 microversion: 2.1 time: 0.195558 Jul 28 04:00:45.215147 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 120/233] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:45 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:45.278073 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-40aa843b-6ea6-455b-a84b-6bde9a9c067d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:45.285537 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-40aa843b-6ea6-455b-a84b-6bde9a9c067d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1265 microversion: 2.1 time: 0.109136 Jul 28 04:00:45.290207 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 114/234] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:45 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:45.368048 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8dae210f-4c77-4588-bb9e-b8615f65dc89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:45.369412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8dae210f-4c77-4588-bb9e-b8615f65dc89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:45.387361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8dae210f-4c77-4588-bb9e-b8615f65dc89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.387862 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8dae210f-4c77-4588-bb9e-b8615f65dc89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.388852 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8dae210f-4c77-4588-bb9e-b8615f65dc89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.389945 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8dae210f-4c77-4588-bb9e-b8615f65dc89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.468597 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8dae210f-4c77-4588-bb9e-b8615f65dc89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:45.477533 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8dae210f-4c77-4588-bb9e-b8615f65dc89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1204 microversion: 2.1 time: 0.114361 Jul 28 04:00:45.478145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 121/235] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:45 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1204 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:46.189162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-763c6882-029e-4922-990e-1ea882092b3a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:46.195101 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-763c6882-029e-4922-990e-1ea882092b3a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:46.198420 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-763c6882-029e-4922-990e-1ea882092b3a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.199064 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-763c6882-029e-4922-990e-1ea882092b3a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.199847 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-763c6882-029e-4922-990e-1ea882092b3a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.200471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-763c6882-029e-4922-990e-1ea882092b3a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.236903 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a28b8660-26bc-4316-9f7d-914de46c8aa8 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:46.237701 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a28b8660-26bc-4316-9f7d-914de46c8aa8 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:46.245949 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a28b8660-26bc-4316-9f7d-914de46c8aa8 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.246424 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a28b8660-26bc-4316-9f7d-914de46c8aa8 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.247220 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a28b8660-26bc-4316-9f7d-914de46c8aa8 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.248187 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a28b8660-26bc-4316-9f7d-914de46c8aa8 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.412132 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a28b8660-26bc-4316-9f7d-914de46c8aa8 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:46.421123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a28b8660-26bc-4316-9f7d-914de46c8aa8 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1315 microversion: 2.1 time: 0.188141 Jul 28 04:00:46.422045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 122/236] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:46 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:46.427351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6a0a7176-2a27-4c5b-8459-52e5a802b2cc tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:46.428178 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6a0a7176-2a27-4c5b-8459-52e5a802b2cc tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:46.436843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a0a7176-2a27-4c5b-8459-52e5a802b2cc tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.437402 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a0a7176-2a27-4c5b-8459-52e5a802b2cc tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.438266 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a0a7176-2a27-4c5b-8459-52e5a802b2cc tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.438900 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a0a7176-2a27-4c5b-8459-52e5a802b2cc tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.444158 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:46.498640 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-763c6882-029e-4922-990e-1ea882092b3a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:46.509177 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-763c6882-029e-4922-990e-1ea882092b3a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.323857 Jul 28 04:00:46.519975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 115/237] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:46 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:46.520171 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6a0a7176-2a27-4c5b-8459-52e5a802b2cc tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:46.520291 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-84f45f6d-b2a3-4132-8027-92168b2a21df tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:46.520291 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-84f45f6d-b2a3-4132-8027-92168b2a21df tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:46.525588 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-84f45f6d-b2a3-4132-8027-92168b2a21df tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.526763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-84f45f6d-b2a3-4132-8027-92168b2a21df tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.527866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-84f45f6d-b2a3-4132-8027-92168b2a21df tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.528439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-84f45f6d-b2a3-4132-8027-92168b2a21df tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.531078 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6a0a7176-2a27-4c5b-8459-52e5a802b2cc tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1271 microversion: 2.1 time: 0.107220 Jul 28 04:00:46.532842 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 123/238] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:46 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:46.761651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-07f25661-a84d-4c7a-aa29-755b9d593b15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:46.762147 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-07f25661-a84d-4c7a-aa29-755b9d593b15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:46.769737 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07f25661-a84d-4c7a-aa29-755b9d593b15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.770196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07f25661-a84d-4c7a-aa29-755b9d593b15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.770983 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07f25661-a84d-4c7a-aa29-755b9d593b15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.771863 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07f25661-a84d-4c7a-aa29-755b9d593b15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.799189 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-07f25661-a84d-4c7a-aa29-755b9d593b15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/ips" status: 200 len: 151 microversion: 2.20 time: 0.041419 Jul 28 04:00:46.799761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 124/239] 10.222.0.66 () {60 vars in 1289 bytes} [Thu Jul 28 04:00:46 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:00:46.836576 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-84f45f6d-b2a3-4132-8027-92168b2a21df tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:46.844958 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-84f45f6d-b2a3-4132-8027-92168b2a21df tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.333519 Jul 28 04:00:46.845578 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 116/240] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:46 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:47.443349 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1da4bf6d-5c2f-4498-9fff-fa6ba582a3c2 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:47.450809 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1da4bf6d-5c2f-4498-9fff-fa6ba582a3c2 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:47.457739 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1da4bf6d-5c2f-4498-9fff-fa6ba582a3c2 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.460345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1da4bf6d-5c2f-4498-9fff-fa6ba582a3c2 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.468956 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1da4bf6d-5c2f-4498-9fff-fa6ba582a3c2 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.469528 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1da4bf6d-5c2f-4498-9fff-fa6ba582a3c2 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.532871 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5a69406c-68e8-4d1c-a131-f0f2e9201447 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:47.534132 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5a69406c-68e8-4d1c-a131-f0f2e9201447 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:47.545181 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5a69406c-68e8-4d1c-a131-f0f2e9201447 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.545891 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5a69406c-68e8-4d1c-a131-f0f2e9201447 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.547118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5a69406c-68e8-4d1c-a131-f0f2e9201447 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.547573 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5a69406c-68e8-4d1c-a131-f0f2e9201447 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.643890 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1da4bf6d-5c2f-4498-9fff-fa6ba582a3c2 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:47.653102 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1da4bf6d-5c2f-4498-9fff-fa6ba582a3c2 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1315 microversion: 2.1 time: 0.213985 Jul 28 04:00:47.663404 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 125/241] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:47 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:47.663404 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5029779f-22fd-4e28-81fc-3fcb7114caf6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:47.663404 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5029779f-22fd-4e28-81fc-3fcb7114caf6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:47.668124 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5029779f-22fd-4e28-81fc-3fcb7114caf6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.668124 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5029779f-22fd-4e28-81fc-3fcb7114caf6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.668921 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5029779f-22fd-4e28-81fc-3fcb7114caf6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.669351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5029779f-22fd-4e28-81fc-3fcb7114caf6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.852616 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5029779f-22fd-4e28-81fc-3fcb7114caf6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:47.859398 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5a69406c-68e8-4d1c-a131-f0f2e9201447 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:47.868615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5029779f-22fd-4e28-81fc-3fcb7114caf6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1313 microversion: 2.1 time: 0.213644 Jul 28 04:00:47.870572 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 126/242] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:47 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:47.875994 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a01df090-47fc-4600-b478-3b8cf909c77b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:47.876699 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a01df090-47fc-4600-b478-3b8cf909c77b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:47.888035 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5a69406c-68e8-4d1c-a131-f0f2e9201447 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.341934 Jul 28 04:00:47.889090 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 117/243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:47 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:47.892185 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a01df090-47fc-4600-b478-3b8cf909c77b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.893263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a01df090-47fc-4600-b478-3b8cf909c77b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.894111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a01df090-47fc-4600-b478-3b8cf909c77b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.894933 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a01df090-47fc-4600-b478-3b8cf909c77b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.906950 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-ac2037b1-0b33-46c1-91d8-5e5ad0a028cd req-cfc2abbe-791f-436c-a10b-41733a629776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed19419-f0b9-473d-93cb-fefb8c29d74e", "tag": "68bf49ef-5416-40a1-b99b-f3cd17caa288"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:47.920015 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-ac2037b1-0b33-46c1-91d8-5e5ad0a028cd req-cfc2abbe-791f-436c-a10b-41733a629776 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.920766 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-ac2037b1-0b33-46c1-91d8-5e5ad0a028cd req-cfc2abbe-791f-436c-a10b-41733a629776 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.936462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a01df090-47fc-4600-b478-3b8cf909c77b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/ips" status: 200 len: 145 microversion: 2.1 time: 0.064294 Jul 28 04:00:47.938255 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 127/244] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 04:00:47 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/ips => generated 145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:47.943322 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-ac2037b1-0b33-46c1-91d8-5e5ad0a028cd req-cfc2abbe-791f-436c-a10b-41733a629776 service nova] Creating event network-changed:68bf49ef-5416-40a1-b99b-f3cd17caa288 for instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e on hv-cinder-85127 Jul 28 04:00:47.945995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-15fde36a-4de8-40a1-902c-2f5c45cdc0d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:47.945995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-15fde36a-4de8-40a1-902c-2f5c45cdc0d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:47.953948 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-ac2037b1-0b33-46c1-91d8-5e5ad0a028cd req-cfc2abbe-791f-436c-a10b-41733a629776 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063346 Jul 28 04:00:47.954151 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-15fde36a-4de8-40a1-902c-2f5c45cdc0d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.954594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-15fde36a-4de8-40a1-902c-2f5c45cdc0d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.955284 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 118/245] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:47.955392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-15fde36a-4de8-40a1-902c-2f5c45cdc0d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.957907 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-15fde36a-4de8-40a1-902c-2f5c45cdc0d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.120130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-15fde36a-4de8-40a1-902c-2f5c45cdc0d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:48.130076 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-15fde36a-4de8-40a1-902c-2f5c45cdc0d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.190327 Jul 28 04:00:48.130671 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 128/246] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:47 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:48.208477 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-92cac59d-a331-4a6c-8566-26f2b8799d51 req-19f45512-c2c4-4126-b011-7d6cdbfc77d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc05300-354f-45e2-b18d-208242b25442", "name": "network-vif-plugged", "status": "completed", "tag": "08a5cd31-ba92-4ee2-a0ac-9245a170d029"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:48.220361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-92cac59d-a331-4a6c-8566-26f2b8799d51 req-19f45512-c2c4-4126-b011-7d6cdbfc77d0 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.220986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-92cac59d-a331-4a6c-8566-26f2b8799d51 req-19f45512-c2c4-4126-b011-7d6cdbfc77d0 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.233180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-92cac59d-a331-4a6c-8566-26f2b8799d51 req-19f45512-c2c4-4126-b011-7d6cdbfc77d0 service nova] Creating event network-vif-plugged:08a5cd31-ba92-4ee2-a0ac-9245a170d029 for instance 7fc05300-354f-45e2-b18d-208242b25442 on hv-cinder-85127 Jul 28 04:00:48.238018 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-92cac59d-a331-4a6c-8566-26f2b8799d51 req-19f45512-c2c4-4126-b011-7d6cdbfc77d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035506 Jul 28 04:00:48.238641 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 119/247] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:48.676504 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-97b7f0dd-c148-47bc-9074-617facb99bf6 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:48.677131 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-97b7f0dd-c148-47bc-9074-617facb99bf6 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:48.689494 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-97b7f0dd-c148-47bc-9074-617facb99bf6 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.690795 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-97b7f0dd-c148-47bc-9074-617facb99bf6 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.692376 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-97b7f0dd-c148-47bc-9074-617facb99bf6 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.692989 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-97b7f0dd-c148-47bc-9074-617facb99bf6 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.825806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-97b7f0dd-c148-47bc-9074-617facb99bf6 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:48.833307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-97b7f0dd-c148-47bc-9074-617facb99bf6 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1315 microversion: 2.1 time: 0.161119 Jul 28 04:00:48.833875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 129/248] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:48 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:48.893489 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c4c3955a-61b9-4beb-963e-b4c29ff2b002 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:48.894160 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c4c3955a-61b9-4beb-963e-b4c29ff2b002 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:48.900632 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c4c3955a-61b9-4beb-963e-b4c29ff2b002 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.901071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c4c3955a-61b9-4beb-963e-b4c29ff2b002 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.901835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c4c3955a-61b9-4beb-963e-b4c29ff2b002 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.902267 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c4c3955a-61b9-4beb-963e-b4c29ff2b002 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.917352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6adb3046-af97-4210-90d7-884a2383c9df tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:48.918433 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6adb3046-af97-4210-90d7-884a2383c9df tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:48.926822 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6adb3046-af97-4210-90d7-884a2383c9df tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.927290 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6adb3046-af97-4210-90d7-884a2383c9df tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.928121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6adb3046-af97-4210-90d7-884a2383c9df tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.928577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6adb3046-af97-4210-90d7-884a2383c9df tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.050759 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c4c3955a-61b9-4beb-963e-b4c29ff2b002 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:49.060234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c4c3955a-61b9-4beb-963e-b4c29ff2b002 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1313 microversion: 2.1 time: 0.170751 Jul 28 04:00:49.060868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 120/249] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:48 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:49.068335 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6adb3046-af97-4210-90d7-884a2383c9df tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:49.076207 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6adb3046-af97-4210-90d7-884a2383c9df tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.165986 Jul 28 04:00:49.083821 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 130/250] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:48 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:49.151697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ed8d0e18-6c62-4465-935a-7fa2ddbf057d tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:49.152343 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ed8d0e18-6c62-4465-935a-7fa2ddbf057d tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:49.158562 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed8d0e18-6c62-4465-935a-7fa2ddbf057d tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.159016 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed8d0e18-6c62-4465-935a-7fa2ddbf057d tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.159810 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed8d0e18-6c62-4465-935a-7fa2ddbf057d tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.160275 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed8d0e18-6c62-4465-935a-7fa2ddbf057d tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.759731 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ed8d0e18-6c62-4465-935a-7fa2ddbf057d tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:49.768826 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ed8d0e18-6c62-4465-935a-7fa2ddbf057d tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.620841 Jul 28 04:00:49.769671 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 121/251] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:49 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:49.855292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-43237471-f787-45cb-842e-d02859889df7 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:49.855984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-43237471-f787-45cb-842e-d02859889df7 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:49.862961 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-43237471-f787-45cb-842e-d02859889df7 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.863427 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-43237471-f787-45cb-842e-d02859889df7 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.864432 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-43237471-f787-45cb-842e-d02859889df7 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.864910 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-43237471-f787-45cb-842e-d02859889df7 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.914560 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-af015e3a-24b2-4da5-9a06-8bc8b89656d0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:49.915170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-af015e3a-24b2-4da5-9a06-8bc8b89656d0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:49.926532 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-af015e3a-24b2-4da5-9a06-8bc8b89656d0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.940472 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-af015e3a-24b2-4da5-9a06-8bc8b89656d0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.941373 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-af015e3a-24b2-4da5-9a06-8bc8b89656d0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.941827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-af015e3a-24b2-4da5-9a06-8bc8b89656d0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.983406 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-af015e3a-24b2-4da5-9a06-8bc8b89656d0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/ips" status: 200 len: 150 microversion: 2.1 time: 0.073455 Jul 28 04:00:49.984255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 122/252] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 04:00:49 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/ips => generated 150 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:50.015761 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-6c1d9e24-5db7-407f-8f1d-27581ab63445 req-c9cf22b7-7257-4a09-a919-324816be243e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bfe516-260b-44cc-b78b-6dfc94941c45", "tag": "d0a469e8-d1be-42d4-a869-5bac46b69fd5"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:50.052086 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-6c1d9e24-5db7-407f-8f1d-27581ab63445 req-c9cf22b7-7257-4a09-a919-324816be243e service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.052771 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-6c1d9e24-5db7-407f-8f1d-27581ab63445 req-c9cf22b7-7257-4a09-a919-324816be243e service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.060335 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-43237471-f787-45cb-842e-d02859889df7 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:50.077141 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-6c1d9e24-5db7-407f-8f1d-27581ab63445 req-c9cf22b7-7257-4a09-a919-324816be243e service nova] Creating event network-changed:d0a469e8-d1be-42d4-a869-5bac46b69fd5 for instance f7bfe516-260b-44cc-b78b-6dfc94941c45 on hv-cinder-85127 Jul 28 04:00:50.078785 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-43237471-f787-45cb-842e-d02859889df7 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1315 microversion: 2.1 time: 0.228009 Jul 28 04:00:50.081001 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 131/253] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:49 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:50.086760 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-caa43bee-7168-47ca-b623-5ff492352640 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:50.091145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-caa43bee-7168-47ca-b623-5ff492352640 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:50.102405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-caa43bee-7168-47ca-b623-5ff492352640 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.103336 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-caa43bee-7168-47ca-b623-5ff492352640 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.104113 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-6c1d9e24-5db7-407f-8f1d-27581ab63445 req-c9cf22b7-7257-4a09-a919-324816be243e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091444 Jul 28 04:00:50.104604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-caa43bee-7168-47ca-b623-5ff492352640 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.105069 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 123/254] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:50.105687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-caa43bee-7168-47ca-b623-5ff492352640 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.111786 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d42e7905-c8cb-4e88-8a25-51fbef6e92c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:50.113158 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d42e7905-c8cb-4e88-8a25-51fbef6e92c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:50.123646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d42e7905-c8cb-4e88-8a25-51fbef6e92c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.123646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d42e7905-c8cb-4e88-8a25-51fbef6e92c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.123646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d42e7905-c8cb-4e88-8a25-51fbef6e92c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.123646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d42e7905-c8cb-4e88-8a25-51fbef6e92c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.269743 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-caa43bee-7168-47ca-b623-5ff492352640 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:50.278351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-caa43bee-7168-47ca-b623-5ff492352640 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1313 microversion: 2.1 time: 0.195349 Jul 28 04:00:50.279200 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 132/255] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:50 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:50.323866 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8cfb9ad9-bc59-47b2-8cc0-bc6d82aab057 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:50.324435 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8cfb9ad9-bc59-47b2-8cc0-bc6d82aab057 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:50.330867 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8cfb9ad9-bc59-47b2-8cc0-bc6d82aab057 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.331215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8cfb9ad9-bc59-47b2-8cc0-bc6d82aab057 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.332033 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8cfb9ad9-bc59-47b2-8cc0-bc6d82aab057 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.332487 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8cfb9ad9-bc59-47b2-8cc0-bc6d82aab057 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.337857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=4 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:50.357126 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-8cfb9ad9-bc59-47b2-8cc0-bc6d82aab057 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lazy-loading 'flavor' on Instance uuid 4eadfe50-2ab9-46dc-be42-b9496e4008ac {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:00:50.408196 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d42e7905-c8cb-4e88-8a25-51fbef6e92c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:50.410555 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=100 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:50.416732 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d42e7905-c8cb-4e88-8a25-51fbef6e92c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.310498 Jul 28 04:00:50.417345 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 124/256] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:50 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:50.791308 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6ca36a61-4d6c-4636-b6e0-e029c2e8ba4c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:50.792063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6ca36a61-4d6c-4636-b6e0-e029c2e8ba4c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:50.798945 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6ca36a61-4d6c-4636-b6e0-e029c2e8ba4c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.801431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6ca36a61-4d6c-4636-b6e0-e029c2e8ba4c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.801431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6ca36a61-4d6c-4636-b6e0-e029c2e8ba4c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.801431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6ca36a61-4d6c-4636-b6e0-e029c2e8ba4c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.854525 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8cfb9ad9-bc59-47b2-8cc0-bc6d82aab057 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/action" status: 202 len: 0 microversion: 2.20 time: 0.534999 Jul 28 04:00:50.855224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 133/257] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Jul 28 04:00:50 2022] POST /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:00:50.864594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:50.865262 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:50.872390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.873285 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.885861 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.885861 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.034329 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.044264 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.045767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.047096 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-edb27edc-3b9a-4f99-b9ed-c522172550ea tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.187348 Jul 28 04:00:51.048032 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 134/258] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:00:50 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:00:51.103387 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-161776d6-dbdd-4e7a-bdd6-f9a79386560f tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:51.104186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-161776d6-dbdd-4e7a-bdd6-f9a79386560f tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:51.110716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-161776d6-dbdd-4e7a-bdd6-f9a79386560f tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.111392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-161776d6-dbdd-4e7a-bdd6-f9a79386560f tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.112292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-161776d6-dbdd-4e7a-bdd6-f9a79386560f tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.112818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-161776d6-dbdd-4e7a-bdd6-f9a79386560f tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.160243 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6ca36a61-4d6c-4636-b6e0-e029c2e8ba4c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.170824 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6ca36a61-4d6c-4636-b6e0-e029c2e8ba4c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.384686 Jul 28 04:00:51.183978 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 125/259] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:50 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:51.257667 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-161776d6-dbdd-4e7a-bdd6-f9a79386560f tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.266466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-161776d6-dbdd-4e7a-bdd6-f9a79386560f tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1315 microversion: 2.1 time: 0.169108 Jul 28 04:00:51.267260 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 135/260] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:51 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:51.305873 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f5aee25e-8567-4ced-a234-f8c60f738c72 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:51.307288 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f5aee25e-8567-4ced-a234-f8c60f738c72 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:51.338565 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f5aee25e-8567-4ced-a234-f8c60f738c72 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.340442 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f5aee25e-8567-4ced-a234-f8c60f738c72 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.341913 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f5aee25e-8567-4ced-a234-f8c60f738c72 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.342596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f5aee25e-8567-4ced-a234-f8c60f738c72 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.437835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1db3b5cf-5b2c-4cea-8317-df2395ec792c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:51.438447 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1db3b5cf-5b2c-4cea-8317-df2395ec792c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:51.444907 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1db3b5cf-5b2c-4cea-8317-df2395ec792c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.445670 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1db3b5cf-5b2c-4cea-8317-df2395ec792c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.451109 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1db3b5cf-5b2c-4cea-8317-df2395ec792c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.451109 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1db3b5cf-5b2c-4cea-8317-df2395ec792c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.588064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1db3b5cf-5b2c-4cea-8317-df2395ec792c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.595716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1db3b5cf-5b2c-4cea-8317-df2395ec792c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.161795 Jul 28 04:00:51.596323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 136/261] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:51 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:51.602714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f5aee25e-8567-4ced-a234-f8c60f738c72 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.610457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f5aee25e-8567-4ced-a234-f8c60f738c72 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1313 microversion: 2.1 time: 0.313338 Jul 28 04:00:51.611196 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 126/262] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:51 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:51.734401 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6a745d0b-37fb-4d08-9f58-97a25a18be70 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07913462-fc39-44ed-8f6d-c4796a432498"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:51.738141 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6a745d0b-37fb-4d08-9f58-97a25a18be70 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:51.746627 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a745d0b-37fb-4d08-9f58-97a25a18be70 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.746627 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a745d0b-37fb-4d08-9f58-97a25a18be70 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.747383 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a745d0b-37fb-4d08-9f58-97a25a18be70 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.748148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6a745d0b-37fb-4d08-9f58-97a25a18be70 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.840997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e5ff7982-9fb5-411b-88ac-ad53047db62d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:51.843346 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e5ff7982-9fb5-411b-88ac-ad53047db62d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:51.846515 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:51.852422 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5ff7982-9fb5-411b-88ac-ad53047db62d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.852964 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5ff7982-9fb5-411b-88ac-ad53047db62d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.854031 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5ff7982-9fb5-411b-88ac-ad53047db62d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.854432 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5ff7982-9fb5-411b-88ac-ad53047db62d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.938471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=16 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:53.060953 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=14 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:54.067436 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:54.266498 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6a745d0b-37fb-4d08-9f58-97a25a18be70 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.535823 Jul 28 04:00:54.267419 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 137/263] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:00:51 2022] POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/os-volume_attachments => generated 194 bytes in 2538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:54.272738 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.273688 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:54.283175 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.283175 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.283175 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.283845 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.367138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e5ff7982-9fb5-411b-88ac-ad53047db62d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.530730 Jul 28 04:00:54.368726 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 127/264] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:00:51 2022] POST /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments => generated 194 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:54.379488 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-afded14c-4009-4f2a-8d9e-0208eb01e84a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.379488 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-afded14c-4009-4f2a-8d9e-0208eb01e84a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:54.379488 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:54.385336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-afded14c-4009-4f2a-8d9e-0208eb01e84a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.385897 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-afded14c-4009-4f2a-8d9e-0208eb01e84a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.386785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-afded14c-4009-4f2a-8d9e-0208eb01e84a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.387334 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-afded14c-4009-4f2a-8d9e-0208eb01e84a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.437444 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.445956 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.447604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.449706 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-be74554e-453e-4431-8d12-334b276fec0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.180987 Jul 28 04:00:54.461913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 138/265] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:00:54 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:00:54.461913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c4823f83-f28f-4a87-81c7-3e5851c0ff09 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.461913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c4823f83-f28f-4a87-81c7-3e5851c0ff09 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:54.468047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4823f83-f28f-4a87-81c7-3e5851c0ff09 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.471545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4823f83-f28f-4a87-81c7-3e5851c0ff09 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.471545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4823f83-f28f-4a87-81c7-3e5851c0ff09 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.471545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4823f83-f28f-4a87-81c7-3e5851c0ff09 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.606365 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-afded14c-4009-4f2a-8d9e-0208eb01e84a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.614000 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-afded14c-4009-4f2a-8d9e-0208eb01e84a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.244000 Jul 28 04:00:54.614590 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 128/266] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:54 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:54.620289 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2f79a38b-d70d-498d-9eb1-22323395d8a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.621109 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2f79a38b-d70d-498d-9eb1-22323395d8a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:54.627702 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2f79a38b-d70d-498d-9eb1-22323395d8a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.628439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2f79a38b-d70d-498d-9eb1-22323395d8a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.629233 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c4823f83-f28f-4a87-81c7-3e5851c0ff09 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.629402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2f79a38b-d70d-498d-9eb1-22323395d8a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.629830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2f79a38b-d70d-498d-9eb1-22323395d8a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.638945 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c4823f83-f28f-4a87-81c7-3e5851c0ff09 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1465 microversion: 2.1 time: 0.186996 Jul 28 04:00:54.639537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 139/267] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:54 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1465 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:54.644564 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-86aca713-cc24-44b0-be56-de879e056d1b tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.645424 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-86aca713-cc24-44b0-be56-de879e056d1b tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:54.652474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-86aca713-cc24-44b0-be56-de879e056d1b tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.653361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-86aca713-cc24-44b0-be56-de879e056d1b tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.654914 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-86aca713-cc24-44b0-be56-de879e056d1b tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.655620 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-86aca713-cc24-44b0-be56-de879e056d1b tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.787164 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2f79a38b-d70d-498d-9eb1-22323395d8a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.794756 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2f79a38b-d70d-498d-9eb1-22323395d8a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.179007 Jul 28 04:00:54.795347 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 129/268] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:54 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:54.800090 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-db63bbfd-15d2-481b-810a-8b60438f7b39 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.800760 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-db63bbfd-15d2-481b-810a-8b60438f7b39 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:54.807292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-86aca713-cc24-44b0-be56-de879e056d1b tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.807771 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-db63bbfd-15d2-481b-810a-8b60438f7b39 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.808268 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-db63bbfd-15d2-481b-810a-8b60438f7b39 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.809072 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-db63bbfd-15d2-481b-810a-8b60438f7b39 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.809783 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-db63bbfd-15d2-481b-810a-8b60438f7b39 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.818179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-86aca713-cc24-44b0-be56-de879e056d1b tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1313 microversion: 2.1 time: 0.177383 Jul 28 04:00:54.818757 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 140/269] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:54 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:54.839920 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-db63bbfd-15d2-481b-810a-8b60438f7b39 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:00:55.156993 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-db63bbfd-15d2-481b-810a-8b60438f7b39 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 204 len: 0 microversion: 2.1 time: 0.360396 Jul 28 04:00:55.157590 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 130/270] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:00:54 2022] DELETE /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:00:55.167474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-730d4f7c-e3b1-4dc8-887d-744e8dae6243 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.167474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-730d4f7c-e3b1-4dc8-887d-744e8dae6243 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.173186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-730d4f7c-e3b1-4dc8-887d-744e8dae6243 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.173716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-730d4f7c-e3b1-4dc8-887d-744e8dae6243 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.174492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-730d4f7c-e3b1-4dc8-887d-744e8dae6243 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.174943 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-730d4f7c-e3b1-4dc8-887d-744e8dae6243 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.326661 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-730d4f7c-e3b1-4dc8-887d-744e8dae6243 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:55.335257 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-730d4f7c-e3b1-4dc8-887d-744e8dae6243 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1471 microversion: 2.1 time: 0.173189 Jul 28 04:00:55.335872 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 141/271] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:55.478247 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.478943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.485126 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.485584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.486410 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.486862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.626839 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:55.638045 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:55.640590 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:55.641558 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bb5cd472-09f0-412e-a54e-950980dbe385 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.642295 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b95467b7-0c61-4a48-adc3-439da6d931a4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.168506 Jul 28 04:00:55.642687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-bb5cd472-09f0-412e-a54e-950980dbe385 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.652378 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 131/272] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:00:55.660145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bb5cd472-09f0-412e-a54e-950980dbe385 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.661043 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bb5cd472-09f0-412e-a54e-950980dbe385 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.661649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bb5cd472-09f0-412e-a54e-950980dbe385 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.662102 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bb5cd472-09f0-412e-a54e-950980dbe385 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.802883 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-bb5cd472-09f0-412e-a54e-950980dbe385 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:55.812147 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-bb5cd472-09f0-412e-a54e-950980dbe385 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.177428 Jul 28 04:00:55.812952 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 142/273] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:55.816601 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a6f8e151-536b-4f55-91c2-4b3d6c95a8fd tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.817352 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a6f8e151-536b-4f55-91c2-4b3d6c95a8fd tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.824929 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a6f8e151-536b-4f55-91c2-4b3d6c95a8fd tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.825613 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a6f8e151-536b-4f55-91c2-4b3d6c95a8fd tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.826398 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a6f8e151-536b-4f55-91c2-4b3d6c95a8fd tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.826885 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a6f8e151-536b-4f55-91c2-4b3d6c95a8fd tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.839832 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0ca021b6-be24-4334-9883-b87ff97d6241 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.840554 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0ca021b6-be24-4334-9883-b87ff97d6241 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.847005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ca021b6-be24-4334-9883-b87ff97d6241 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.847471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ca021b6-be24-4334-9883-b87ff97d6241 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.848284 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ca021b6-be24-4334-9883-b87ff97d6241 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.848733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ca021b6-be24-4334-9883-b87ff97d6241 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.982257 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a6f8e151-536b-4f55-91c2-4b3d6c95a8fd tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:55.990558 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a6f8e151-536b-4f55-91c2-4b3d6c95a8fd tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.177740 Jul 28 04:00:55.991417 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 132/274] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:56.007236 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0ca021b6-be24-4334-9883-b87ff97d6241 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:56.015592 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0ca021b6-be24-4334-9883-b87ff97d6241 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1313 microversion: 2.1 time: 0.180311 Jul 28 04:00:56.016360 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 143/275] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:56.302800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-447b6173-cf61-44cc-9ce8-15a53a606ee8 req-fa9029f1-05a2-4029-b2a6-dbdc1b80d042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bfe516-260b-44cc-b78b-6dfc94941c45", "name": "network-vif-plugged", "status": "completed", "tag": "d0a469e8-d1be-42d4-a869-5bac46b69fd5"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:56.315009 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-447b6173-cf61-44cc-9ce8-15a53a606ee8 req-fa9029f1-05a2-4029-b2a6-dbdc1b80d042 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.315533 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-447b6173-cf61-44cc-9ce8-15a53a606ee8 req-fa9029f1-05a2-4029-b2a6-dbdc1b80d042 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.327738 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-447b6173-cf61-44cc-9ce8-15a53a606ee8 req-fa9029f1-05a2-4029-b2a6-dbdc1b80d042 service nova] Creating event network-vif-plugged:d0a469e8-d1be-42d4-a869-5bac46b69fd5 for instance f7bfe516-260b-44cc-b78b-6dfc94941c45 on hv-cinder-85127 Jul 28 04:00:56.332600 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-447b6173-cf61-44cc-9ce8-15a53a606ee8 req-fa9029f1-05a2-4029-b2a6-dbdc1b80d042 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033415 Jul 28 04:00:56.333183 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 133/276] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:56.357039 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6d263a53-2d32-4f42-941a-15db12c0aa6e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:56.357647 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6d263a53-2d32-4f42-941a-15db12c0aa6e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:56.363747 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6d263a53-2d32-4f42-941a-15db12c0aa6e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.364234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6d263a53-2d32-4f42-941a-15db12c0aa6e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.364997 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6d263a53-2d32-4f42-941a-15db12c0aa6e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.365436 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6d263a53-2d32-4f42-941a-15db12c0aa6e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.519741 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6d263a53-2d32-4f42-941a-15db12c0aa6e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:56.527482 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6d263a53-2d32-4f42-941a-15db12c0aa6e tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1471 microversion: 2.1 time: 0.174227 Jul 28 04:00:56.528187 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 144/277] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:56 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:56.666858 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:56.667683 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:56.673835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.674281 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.675073 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.675511 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.833684 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ea78a4db-528a-476a-964b-ad7f66179974 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:56.834301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ea78a4db-528a-476a-964b-ad7f66179974 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:56.841605 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ea78a4db-528a-476a-964b-ad7f66179974 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.842571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ea78a4db-528a-476a-964b-ad7f66179974 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.843262 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ea78a4db-528a-476a-964b-ad7f66179974 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.843902 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ea78a4db-528a-476a-964b-ad7f66179974 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.879511 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:56.891710 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:56.900577 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:56.902587 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ce646c09-07a1-448f-a4d2-7fe511a67ce9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.240982 Jul 28 04:00:56.910693 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 134/278] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:00:56 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:00:57.005915 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ea78a4db-528a-476a-964b-ad7f66179974 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:57.014720 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4560bc48-abf3-4df7-ad9f-9270fa204aab tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:57.015687 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4560bc48-abf3-4df7-ad9f-9270fa204aab tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:57.016233 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ea78a4db-528a-476a-964b-ad7f66179974 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.186233 Jul 28 04:00:57.016972 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 145/279] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:56 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:57.024174 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4560bc48-abf3-4df7-ad9f-9270fa204aab tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.024174 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4560bc48-abf3-4df7-ad9f-9270fa204aab tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.024174 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4560bc48-abf3-4df7-ad9f-9270fa204aab tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.024521 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4560bc48-abf3-4df7-ad9f-9270fa204aab tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.037573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bd9a29c3-5596-4ab2-a075-c41241d92164 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:57.038325 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-bd9a29c3-5596-4ab2-a075-c41241d92164 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:57.045298 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd9a29c3-5596-4ab2-a075-c41241d92164 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.046082 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd9a29c3-5596-4ab2-a075-c41241d92164 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.047715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd9a29c3-5596-4ab2-a075-c41241d92164 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.048595 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd9a29c3-5596-4ab2-a075-c41241d92164 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.179708 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4560bc48-abf3-4df7-ad9f-9270fa204aab tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:57.188245 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4560bc48-abf3-4df7-ad9f-9270fa204aab tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.177975 Jul 28 04:00:57.188831 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 135/280] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:57 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:57.217130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-bd9a29c3-5596-4ab2-a075-c41241d92164 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:57.224991 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-bd9a29c3-5596-4ab2-a075-c41241d92164 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1313 microversion: 2.1 time: 0.191470 Jul 28 04:00:57.225578 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 146/281] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:57 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:57.549307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8a3b81b2-b1c4-4963-96aa-6e81bf9d5a38 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:57.549919 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8a3b81b2-b1c4-4963-96aa-6e81bf9d5a38 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:57.557112 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a3b81b2-b1c4-4963-96aa-6e81bf9d5a38 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.557568 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a3b81b2-b1c4-4963-96aa-6e81bf9d5a38 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.558357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a3b81b2-b1c4-4963-96aa-6e81bf9d5a38 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.558798 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a3b81b2-b1c4-4963-96aa-6e81bf9d5a38 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.825227 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8a3b81b2-b1c4-4963-96aa-6e81bf9d5a38 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:57.836573 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8a3b81b2-b1c4-4963-96aa-6e81bf9d5a38 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1471 microversion: 2.1 time: 0.290427 Jul 28 04:00:57.837375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 136/282] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:57 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:57.925906 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:57.926638 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:57.936126 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.936674 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.937730 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.938261 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.041523 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e2465e87-94a3-48c2-9e37-2fa81dda133c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:58.042620 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e2465e87-94a3-48c2-9e37-2fa81dda133c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.051320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e2465e87-94a3-48c2-9e37-2fa81dda133c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.052192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e2465e87-94a3-48c2-9e37-2fa81dda133c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.053342 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e2465e87-94a3-48c2-9e37-2fa81dda133c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.054017 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e2465e87-94a3-48c2-9e37-2fa81dda133c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.179609 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:58.197177 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:58.199195 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:58.200648 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8a54bf46-2e73-49de-8f5a-76f9399b0a58 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.278907 Jul 28 04:00:58.201643 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 147/283] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:00:57 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:00:58.212138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-379ef192-df29-4334-9553-410d043cf343 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:58.213891 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-379ef192-df29-4334-9553-410d043cf343 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.231188 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-379ef192-df29-4334-9553-410d043cf343 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.231188 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-379ef192-df29-4334-9553-410d043cf343 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.231188 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-379ef192-df29-4334-9553-410d043cf343 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.231188 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-379ef192-df29-4334-9553-410d043cf343 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.393817 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-379ef192-df29-4334-9553-410d043cf343 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:58.406132 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-379ef192-df29-4334-9553-410d043cf343 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1501 microversion: 2.1 time: 0.199085 Jul 28 04:00:58.416752 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 148/284] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:58 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:58.420552 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b1594f9c-c5a4-4a9d-96ca-757817b24398 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:58.421379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b1594f9c-c5a4-4a9d-96ca-757817b24398 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.427687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b1594f9c-c5a4-4a9d-96ca-757817b24398 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.428211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b1594f9c-c5a4-4a9d-96ca-757817b24398 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.429000 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b1594f9c-c5a4-4a9d-96ca-757817b24398 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.429453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b1594f9c-c5a4-4a9d-96ca-757817b24398 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.501304 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e2465e87-94a3-48c2-9e37-2fa81dda133c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:58.510183 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e2465e87-94a3-48c2-9e37-2fa81dda133c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.475829 Jul 28 04:00:58.520867 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 137/285] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:58 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:58.529936 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d4dd3c6-0567-44c4-93f7-0bfbcb0ca91d"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:58.532956 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.542253 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.542701 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.543529 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.544054 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.571239 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] HTTP exception thrown: Cannot 'attach_volume' instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 while it is in vm_state rescued Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Request method failure captured: Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: POST /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9/os-volume_attachments HTTP/1.1 Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 74 Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmKWLvqHiajw7Vtw-f2vvp_0YIjU3hSWiY17ioucOls7t40OrsIG6OSQelvM8vSidvlTrUkQl_D2V_jlVb0xPoWv0cI31HO1ossk5jJ2gT7TKd33Bz9cKC_3eCS5JpW3XRsx57me7iAOdWTxirrq9O4DR5qeUqvuAN28zh0ABaN-l0 Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:00:58.577808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8bf7f0f7880a435ba552361bcb31ef91", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}] Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 4251e84650f047c9a6eb0c3b16b25564 Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {"volumeAttachment": {"volumeId": "7d4dd3c6-0567-44c4-93f7-0bfbcb0ca91d"}} Jul 28 04:00:58.579092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Cannot 'attach_volume' instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 while it is in vm_state rescued Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'server_id': 'a30f5c60-8ee4-4d46-aec9-34dd464d21b9', 'body': {'volumeAttachment': {'volumeId': '7d4dd3c6-0567-44c4-93f7-0bfbcb0ca91d'}}} Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:58.579864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 while it is in vm_state rescued Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:58.581396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:58.582881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:58.582881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:58.582881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 while it is in vm_state rescued Jul 28 04:00:58.582881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:00:58.582881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Returning 409 to user: Cannot 'attach_volume' instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 while it is in vm_state rescued {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:58.582881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-57d7fd89-c119-4244-ba0a-9799d2e0209b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057331 Jul 28 04:00:58.583738 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 138/286] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:00:58 2022] POST /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:00:58.595830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-da3faab2-0fab-425c-a164-e01f83e0f996 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:58.596404 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-da3faab2-0fab-425c-a164-e01f83e0f996 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.603637 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b1594f9c-c5a4-4a9d-96ca-757817b24398 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:58.604283 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-da3faab2-0fab-425c-a164-e01f83e0f996 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.604491 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-da3faab2-0fab-425c-a164-e01f83e0f996 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.605287 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-da3faab2-0fab-425c-a164-e01f83e0f996 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.605742 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-da3faab2-0fab-425c-a164-e01f83e0f996 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.618400 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b1594f9c-c5a4-4a9d-96ca-757817b24398 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1313 microversion: 2.1 time: 0.208662 Jul 28 04:00:58.621122 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:58.626291 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 149/287] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:58 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:58.764190 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-f1b3ea05-3861-439a-8837-31cf83316daa req-5a367ff6-ca3e-40e5-96de-07fc41fadf4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc05300-354f-45e2-b18d-208242b25442", "name": "network-vif-deleted", "tag": "08a5cd31-ba92-4ee2-a0ac-9245a170d029"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:58.782981 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-f1b3ea05-3861-439a-8837-31cf83316daa req-5a367ff6-ca3e-40e5-96de-07fc41fadf4d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.782981 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-f1b3ea05-3861-439a-8837-31cf83316daa req-5a367ff6-ca3e-40e5-96de-07fc41fadf4d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.795684 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-f1b3ea05-3861-439a-8837-31cf83316daa req-5a367ff6-ca3e-40e5-96de-07fc41fadf4d service nova] Creating event network-vif-deleted:08a5cd31-ba92-4ee2-a0ac-9245a170d029 for instance 7fc05300-354f-45e2-b18d-208242b25442 on hv-cinder-85127 Jul 28 04:00:58.801602 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-f1b3ea05-3861-439a-8837-31cf83316daa req-5a367ff6-ca3e-40e5-96de-07fc41fadf4d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045196 Jul 28 04:00:58.802778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 150/288] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:58.860539 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6b335e61-e757-443f-9bfe-3345d8db0601 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:58.861412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6b335e61-e757-443f-9bfe-3345d8db0601 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.874584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-da3faab2-0fab-425c-a164-e01f83e0f996 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9/action" status: 202 len: 0 microversion: 2.1 time: 0.287108 Jul 28 04:00:58.874584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 139/289] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:00:58 2022] POST /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:00:58.884252 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-68573b3b-1b0c-4cbf-a55a-5babb3d75330 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:58.889048 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b335e61-e757-443f-9bfe-3345d8db0601 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.890815 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-68573b3b-1b0c-4cbf-a55a-5babb3d75330 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.891860 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b335e61-e757-443f-9bfe-3345d8db0601 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.893922 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b335e61-e757-443f-9bfe-3345d8db0601 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.895884 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b335e61-e757-443f-9bfe-3345d8db0601 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.910283 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-68573b3b-1b0c-4cbf-a55a-5babb3d75330 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.911003 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-68573b3b-1b0c-4cbf-a55a-5babb3d75330 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.911985 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-68573b3b-1b0c-4cbf-a55a-5babb3d75330 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.912584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-68573b3b-1b0c-4cbf-a55a-5babb3d75330 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.003856 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6b335e61-e757-443f-9bfe-3345d8db0601 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.012235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6b335e61-e757-443f-9bfe-3345d8db0601 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1429 microversion: 2.1 time: 0.156745 Jul 28 04:00:59.012816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 151/290] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:58 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1429 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:59.074194 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-68573b3b-1b0c-4cbf-a55a-5babb3d75330 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.082725 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-68573b3b-1b0c-4cbf-a55a-5babb3d75330 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1509 microversion: 2.1 time: 0.203171 Jul 28 04:00:59.083313 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 140/291] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:58 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:59.227786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:59.228421 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:59.234418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.234880 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.235636 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.236104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.377687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.385770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.387680 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.389104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fcb30923-4c7b-411b-9268-be439d1e6250 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.165569 Jul 28 04:00:59.389672 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 152/292] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:00:59 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:00:59.534429 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-104d5b19-fded-4b82-bba2-8cb24e812ec2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:59.535043 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-104d5b19-fded-4b82-bba2-8cb24e812ec2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:59.541756 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-104d5b19-fded-4b82-bba2-8cb24e812ec2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.542207 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-104d5b19-fded-4b82-bba2-8cb24e812ec2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.542975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-104d5b19-fded-4b82-bba2-8cb24e812ec2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.543415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-104d5b19-fded-4b82-bba2-8cb24e812ec2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.646918 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8ac32797-b53e-4d80-adb5-677b3a0d14fd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:59.647518 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8ac32797-b53e-4d80-adb5-677b3a0d14fd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:59.655633 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8ac32797-b53e-4d80-adb5-677b3a0d14fd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.657300 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8ac32797-b53e-4d80-adb5-677b3a0d14fd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.657300 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8ac32797-b53e-4d80-adb5-677b3a0d14fd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.658679 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8ac32797-b53e-4d80-adb5-677b3a0d14fd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.686958 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-104d5b19-fded-4b82-bba2-8cb24e812ec2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.694394 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-104d5b19-fded-4b82-bba2-8cb24e812ec2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.163823 Jul 28 04:00:59.695180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 141/293] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:59 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:59.830985 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8ac32797-b53e-4d80-adb5-677b3a0d14fd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.838951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8ac32797-b53e-4d80-adb5-677b3a0d14fd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1313 microversion: 2.1 time: 0.196256 Jul 28 04:00:59.839523 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 153/294] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:59 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:00.033150 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:00.034276 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:00.041965 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.042612 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.043417 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.044389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.090356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.090930 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.091449 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lazy-loading 'fault' on Instance uuid 7fc05300-354f-45e2-b18d-208242b25442 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:01:00.106335 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-44454e07-0a11-4ac7-b4fc-7351a7bab3a2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:00.107621 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-44454e07-0a11-4ac7-b4fc-7351a7bab3a2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:00.114285 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44454e07-0a11-4ac7-b4fc-7351a7bab3a2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.114836 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44454e07-0a11-4ac7-b4fc-7351a7bab3a2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.115714 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44454e07-0a11-4ac7-b4fc-7351a7bab3a2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.116268 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44454e07-0a11-4ac7-b4fc-7351a7bab3a2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.139589 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:00.163193 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ca9e08af84d8cb43de592027c90f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3703ddd7285740f593e7269eac250ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.177408 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e46dbef8-1384-436e-a467-36bf8fb07101 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 200 len: 1305 microversion: 2.1 time: 0.145588 Jul 28 04:01:00.180935 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 142/295] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:00 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:00.249322 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-fb39911e-e70a-4ab8-ba60-6890e55279b3 req-549f7891-1f54-4058-9684-ac2ade5b36fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed19419-f0b9-473d-93cb-fefb8c29d74e", "name": "network-vif-plugged", "status": "completed", "tag": "68bf49ef-5416-40a1-b99b-f3cd17caa288"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:00.260388 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-fb39911e-e70a-4ab8-ba60-6890e55279b3 req-549f7891-1f54-4058-9684-ac2ade5b36fb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.261415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-fb39911e-e70a-4ab8-ba60-6890e55279b3 req-549f7891-1f54-4058-9684-ac2ade5b36fb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.273170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-fb39911e-e70a-4ab8-ba60-6890e55279b3 req-549f7891-1f54-4058-9684-ac2ade5b36fb service nova] Creating event network-vif-plugged:68bf49ef-5416-40a1-b99b-f3cd17caa288 for instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e on hv-cinder-85127 Jul 28 04:01:00.280494 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-fb39911e-e70a-4ab8-ba60-6890e55279b3 req-549f7891-1f54-4058-9684-ac2ade5b36fb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035274 Jul 28 04:01:00.281093 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 143/296] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:00.329364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-44454e07-0a11-4ac7-b4fc-7351a7bab3a2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.336577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-44454e07-0a11-4ac7-b4fc-7351a7bab3a2 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1509 microversion: 2.1 time: 0.236040 Jul 28 04:01:00.337162 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 154/297] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:00 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:00.413242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:00.413936 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:00.421500 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.421964 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.422754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.423204 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.609799 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.618267 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.619820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.621040 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6d242dcf-bc5b-4839-b5c1-35f2e72e8bac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.212387 Jul 28 04:01:00.622086 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 144/298] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:00 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:00.717474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-16f0aa45-0f75-464e-8fe3-5ebf3d627f89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:00.718102 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-16f0aa45-0f75-464e-8fe3-5ebf3d627f89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:00.725755 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-16f0aa45-0f75-464e-8fe3-5ebf3d627f89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.726716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-16f0aa45-0f75-464e-8fe3-5ebf3d627f89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.729245 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-16f0aa45-0f75-464e-8fe3-5ebf3d627f89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.729769 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-16f0aa45-0f75-464e-8fe3-5ebf3d627f89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.860428 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-30371b8a-4839-453c-9d8d-482c24a376d4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:00.861052 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-30371b8a-4839-453c-9d8d-482c24a376d4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:00.871169 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30371b8a-4839-453c-9d8d-482c24a376d4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.871627 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30371b8a-4839-453c-9d8d-482c24a376d4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.880310 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30371b8a-4839-453c-9d8d-482c24a376d4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.880310 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30371b8a-4839-453c-9d8d-482c24a376d4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.962403 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-16f0aa45-0f75-464e-8fe3-5ebf3d627f89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.973383 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-16f0aa45-0f75-464e-8fe3-5ebf3d627f89 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.260410 Jul 28 04:01:00.975857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 155/299] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:00 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:01.140311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-30371b8a-4839-453c-9d8d-482c24a376d4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:01.148186 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-30371b8a-4839-453c-9d8d-482c24a376d4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1494 microversion: 2.1 time: 0.291990 Jul 28 04:01:01.149646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 145/300] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:00 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1494 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:01.199753 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:01.201083 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] [instance: 7fc05300-354f-45e2-b18d-208242b25442] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:01.207452 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.207916 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.208733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.209181 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.223854 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] HTTP exception thrown: Instance 7fc05300-354f-45e2-b18d-208242b25442 could not be found. Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Request method failure captured: Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 HTTP/1.1 Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gni__O-4p8eBJVAVu6QNecDF3TBjKCem-TFJ-NZwY0m_CilY2kEtN6uMTBldIZz2egr-4NNAa2fyDQ5PKlFVoV__D7bovl8TIFvmhwaIvusuodmefv35edFZ6W_3kP5wsRrGmprkJXMCW-s4WCDJiesglWJTkFNsvm1zcMnzdgBjo4 Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 3703ddd7285740f593e7269eac250ebc Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-VolumesNegativeTest-938470920 Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:01:01.225557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3703ddd7285740f593e7269eac250ebc", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3703ddd7285740f593e7269eac250ebc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3703ddd7285740f593e7269eac250ebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3703ddd7285740f593e7269eac250ebc"}]}] Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-VolumesNegativeTest-938470920 Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 3703ddd7285740f593e7269eac250ebc Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-VolumesNegativeTest-938470920 Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-VolumesNegativeTest-938470920-project Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 619ca9e08af84d8cb43de592027c90f6 Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-VolumesNegativeTest-938470920-project Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 7fc05300-354f-45e2-b18d-208242b25442 could not be found. Jul 28 04:01:01.227229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '7fc05300-354f-45e2-b18d-208242b25442'} Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc05300-354f-45e2-b18d-208242b25442 could not be found. Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:01:01.228138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc05300-354f-45e2-b18d-208242b25442 could not be found. Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc05300-354f-45e2-b18d-208242b25442 could not be found. Jul 28 04:01:01.229579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:01.230937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] Returning 404 to user: Instance 7fc05300-354f-45e2-b18d-208242b25442 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:01:01.230937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a2808bd2-52ea-4a1c-a242-725dcf270ab9 tempest-VolumesNegativeTest-938470920 tempest-VolumesNegativeTest-938470920-project] 10.222.0.66 "GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442" status: 404 len: 111 microversion: 2.1 time: 0.032513 Jul 28 04:01:01.230937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 156/301] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:01 2022] GET /compute/v2.1/servers/7fc05300-354f-45e2-b18d-208242b25442 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:01:01.357433 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-aef812b3-5fc5-4ac2-bcdc-accddfcff459 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:01.358065 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-aef812b3-5fc5-4ac2-bcdc-accddfcff459 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:01.364298 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aef812b3-5fc5-4ac2-bcdc-accddfcff459 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.364774 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aef812b3-5fc5-4ac2-bcdc-accddfcff459 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.365584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aef812b3-5fc5-4ac2-bcdc-accddfcff459 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.366064 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aef812b3-5fc5-4ac2-bcdc-accddfcff459 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.516684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-aef812b3-5fc5-4ac2-bcdc-accddfcff459 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:01.524748 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-aef812b3-5fc5-4ac2-bcdc-accddfcff459 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1509 microversion: 2.1 time: 0.171230 Jul 28 04:01:01.525325 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 146/302] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:01 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:01.645001 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:01.651092 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:01.660930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.661426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.662224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.662843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.888503 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:01.897232 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:01.898916 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:01.900134 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f36bbd9c-eb76-4420-898c-3a21f33f67a9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.258974 Jul 28 04:01:01.916504 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 157/303] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:01 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:02.008966 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7e995364-84e7-4113-a0ea-0c5d5599e865 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.009497 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7e995364-84e7-4113-a0ea-0c5d5599e865 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.015749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7e995364-84e7-4113-a0ea-0c5d5599e865 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.016233 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7e995364-84e7-4113-a0ea-0c5d5599e865 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.017001 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7e995364-84e7-4113-a0ea-0c5d5599e865 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.017471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7e995364-84e7-4113-a0ea-0c5d5599e865 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.169201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7e995364-84e7-4113-a0ea-0c5d5599e865 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:02.190093 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7e995364-84e7-4113-a0ea-0c5d5599e865 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.184993 Jul 28 04:01:02.190682 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 147/304] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:02 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:02.234979 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0325b608-57ad-4a56-acc2-f1620c1979ea tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.235586 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0325b608-57ad-4a56-acc2-f1620c1979ea tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.242375 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0325b608-57ad-4a56-acc2-f1620c1979ea tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.242712 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0325b608-57ad-4a56-acc2-f1620c1979ea tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.248659 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0325b608-57ad-4a56-acc2-f1620c1979ea tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.249270 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0325b608-57ad-4a56-acc2-f1620c1979ea tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.277333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0325b608-57ad-4a56-acc2-f1620c1979ea tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:01:02.546839 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-59e639fd-3b0b-45a7-a6d0-b49a9c65d261 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.547689 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-59e639fd-3b0b-45a7-a6d0-b49a9c65d261 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.555149 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-59e639fd-3b0b-45a7-a6d0-b49a9c65d261 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.556128 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-59e639fd-3b0b-45a7-a6d0-b49a9c65d261 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.557066 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-59e639fd-3b0b-45a7-a6d0-b49a9c65d261 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.558169 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-59e639fd-3b0b-45a7-a6d0-b49a9c65d261 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.593826 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:02.681345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0325b608-57ad-4a56-acc2-f1620c1979ea tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 204 len: 0 microversion: 2.1 time: 0.449865 Jul 28 04:01:02.681942 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 158/305] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:01:02 2022] DELETE /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:01:02.690588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f7f29e66-c6aa-4f87-a048-2b3f07cb70f6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.691294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f7f29e66-c6aa-4f87-a048-2b3f07cb70f6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.697359 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f7f29e66-c6aa-4f87-a048-2b3f07cb70f6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.697534 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-59e639fd-3b0b-45a7-a6d0-b49a9c65d261 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:02.697811 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f7f29e66-c6aa-4f87-a048-2b3f07cb70f6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.698587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f7f29e66-c6aa-4f87-a048-2b3f07cb70f6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.699028 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f7f29e66-c6aa-4f87-a048-2b3f07cb70f6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.712305 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-59e639fd-3b0b-45a7-a6d0-b49a9c65d261 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1509 microversion: 2.1 time: 0.169243 Jul 28 04:01:02.713115 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 148/306] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:02 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:02.854269 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f7f29e66-c6aa-4f87-a048-2b3f07cb70f6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:02.862010 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f7f29e66-c6aa-4f87-a048-2b3f07cb70f6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1500 microversion: 2.1 time: 0.175574 Jul 28 04:01:02.866383 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 159/307] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:02 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1500 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:02.925928 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.926557 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.933584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.934045 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.934828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.935459 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.099924 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:03.108831 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:03.110390 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:03.111618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b7557289-c781-4744-95d7-9e93208da77f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.189933 Jul 28 04:01:03.112202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 149/308] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:02 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:03.216544 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-35ed6c35-cdb8-49b2-9776-a69cbed75d0e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:03.217140 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-35ed6c35-cdb8-49b2-9776-a69cbed75d0e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:03.223124 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-35ed6c35-cdb8-49b2-9776-a69cbed75d0e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.223561 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-35ed6c35-cdb8-49b2-9776-a69cbed75d0e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.224360 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-35ed6c35-cdb8-49b2-9776-a69cbed75d0e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.224805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-35ed6c35-cdb8-49b2-9776-a69cbed75d0e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.402471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-35ed6c35-cdb8-49b2-9776-a69cbed75d0e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:03.410050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-35ed6c35-cdb8-49b2-9776-a69cbed75d0e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.197238 Jul 28 04:01:03.411368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 160/309] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:03 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:03.735353 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6d25c5f0-37ac-49fc-aa71-314691e23937 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:03.735991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6d25c5f0-37ac-49fc-aa71-314691e23937 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:03.742139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d25c5f0-37ac-49fc-aa71-314691e23937 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.743736 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d25c5f0-37ac-49fc-aa71-314691e23937 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.744510 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d25c5f0-37ac-49fc-aa71-314691e23937 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.744950 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6d25c5f0-37ac-49fc-aa71-314691e23937 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.884920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fce01859-054e-487a-b364-5a3d64f70e30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:03.886122 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fce01859-054e-487a-b364-5a3d64f70e30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:03.891612 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6d25c5f0-37ac-49fc-aa71-314691e23937 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:03.893001 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fce01859-054e-487a-b364-5a3d64f70e30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.893670 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fce01859-054e-487a-b364-5a3d64f70e30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.894655 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fce01859-054e-487a-b364-5a3d64f70e30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.895353 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fce01859-054e-487a-b364-5a3d64f70e30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.899633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6d25c5f0-37ac-49fc-aa71-314691e23937 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1515 microversion: 2.1 time: 0.168220 Jul 28 04:01:03.901190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 150/310] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:03 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:04.056525 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fce01859-054e-487a-b364-5a3d64f70e30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:04.064738 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fce01859-054e-487a-b364-5a3d64f70e30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1500 microversion: 2.1 time: 0.184761 Jul 28 04:01:04.065315 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 161/311] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:03 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1500 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:04.134888 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:04.135105 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:04.141917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.142363 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:04.143205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.143699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:04.292308 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:04.301605 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:04.303522 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:04.305262 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-218525aa-0b9c-4aee-8743-a525421a176a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.174424 Jul 28 04:01:04.306269 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 151/312] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:04 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:04.431662 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-01d7729a-a998-4560-94ac-98642cc68f5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:04.432312 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-01d7729a-a998-4560-94ac-98642cc68f5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:04.439068 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01d7729a-a998-4560-94ac-98642cc68f5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.439526 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01d7729a-a998-4560-94ac-98642cc68f5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:04.440448 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01d7729a-a998-4560-94ac-98642cc68f5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.440900 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01d7729a-a998-4560-94ac-98642cc68f5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:04.597781 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-01d7729a-a998-4560-94ac-98642cc68f5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:04.606129 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-01d7729a-a998-4560-94ac-98642cc68f5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1259 microversion: 2.1 time: 0.179169 Jul 28 04:01:04.606706 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 162/313] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:04 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:05.086753 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ef7f890c-33e5-4056-a14c-d02ec77053e8 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:05.087478 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ef7f890c-33e5-4056-a14c-d02ec77053e8 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:05.093664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef7f890c-33e5-4056-a14c-d02ec77053e8 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.094127 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef7f890c-33e5-4056-a14c-d02ec77053e8 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.094906 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef7f890c-33e5-4056-a14c-d02ec77053e8 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.095349 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef7f890c-33e5-4056-a14c-d02ec77053e8 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.236502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ef7f890c-33e5-4056-a14c-d02ec77053e8 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:05.244277 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ef7f890c-33e5-4056-a14c-d02ec77053e8 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1500 microversion: 2.1 time: 0.161659 Jul 28 04:01:05.244862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 152/314] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:05 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:05.346851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:05.348429 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:05.362657 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.363167 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.364071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.364685 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.530216 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:05.539022 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:05.541179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:05.542487 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b4aed8a3-217d-45d3-9c8a-39976cff5b67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.200648 Jul 28 04:01:05.543264 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 163/315] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:05 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:05.627995 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8ae42614-b5fb-488b-9fe1-4a2f0ab0c6d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:05.628856 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8ae42614-b5fb-488b-9fe1-4a2f0ab0c6d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:05.635275 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ae42614-b5fb-488b-9fe1-4a2f0ab0c6d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.635798 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ae42614-b5fb-488b-9fe1-4a2f0ab0c6d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.641964 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ae42614-b5fb-488b-9fe1-4a2f0ab0c6d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.641964 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ae42614-b5fb-488b-9fe1-4a2f0ab0c6d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.717892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9d615828-416d-4453-8fa1-000149d5afd3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'create', calling method: .version_select at 0x7f5578167700>, body: {"keypair": {"name": "tempest-keypair-1414986290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJikA5lB3HRdQlivhy+CfGffeinT2D5wRLQW31ekafnR1+HvhHg21z9dChI14wUCL3fe95EssdS/nnWTMo8qXRzXArEG+22crFCK+ySDTupn1vxwsYc97qiwhHgt9l8iLQ=="}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:05.741824 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-9d615828-416d-4453-8fa1-000149d5afd3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Getting quotas for project 8bf7f0f7880a435ba552361bcb31ef91. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:01:05.753310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-9d615828-416d-4453-8fa1-000149d5afd3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Getting quotas for user 4251e84650f047c9a6eb0c3b16b25564 and project 8bf7f0f7880a435ba552361bcb31ef91. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:01:05.791009 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8ae42614-b5fb-488b-9fe1-4a2f0ab0c6d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:05.800754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8ae42614-b5fb-488b-9fe1-4a2f0ab0c6d0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1444 microversion: 2.1 time: 0.176883 Jul 28 04:01:05.801411 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 153/316] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:05 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1444 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:05.823023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-413fdd16-f521-49d3-8c83-85aadef4890f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:05.824024 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-413fdd16-f521-49d3-8c83-85aadef4890f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:05.830558 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-413fdd16-f521-49d3-8c83-85aadef4890f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.831268 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-413fdd16-f521-49d3-8c83-85aadef4890f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.832285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-413fdd16-f521-49d3-8c83-85aadef4890f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.832895 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-413fdd16-f521-49d3-8c83-85aadef4890f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.907676 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9d615828-416d-4453-8fa1-000149d5afd3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193417 Jul 28 04:01:05.921291 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 164/317] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 04:01:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:05.995111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-413fdd16-f521-49d3-8c83-85aadef4890f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:06.006593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-413fdd16-f521-49d3-8c83-85aadef4890f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1444 microversion: 2.1 time: 0.184707 Jul 28 04:01:06.006593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 154/318] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:05 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1444 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:06.265951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-639abb27-c046-4ead-99e1-b410b471daec tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:06.266926 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-639abb27-c046-4ead-99e1-b410b471daec tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:06.278523 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-639abb27-c046-4ead-99e1-b410b471daec tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.278990 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-639abb27-c046-4ead-99e1-b410b471daec tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.281397 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-639abb27-c046-4ead-99e1-b410b471daec tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.281397 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-639abb27-c046-4ead-99e1-b410b471daec tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.463614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-639abb27-c046-4ead-99e1-b410b471daec tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:06.471744 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-639abb27-c046-4ead-99e1-b410b471daec tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1500 microversion: 2.1 time: 0.209753 Jul 28 04:01:06.472461 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 165/319] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:06 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1500 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:06.568866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:06.569476 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:06.577856 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.578314 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.579097 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.579541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.608955 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:06.978836 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:06.991029 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:06.992636 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:06.994452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-466231f7-b70c-4e2a-8ac8-17f8455595ec tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.430905 Jul 28 04:01:06.995015 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 155/320] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:06 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:07.495697 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-92d45513-7e4a-467b-b6cb-e7845b6b86b4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:07.496341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-92d45513-7e4a-467b-b6cb-e7845b6b86b4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:07.512864 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-92d45513-7e4a-467b-b6cb-e7845b6b86b4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:07.513227 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-92d45513-7e4a-467b-b6cb-e7845b6b86b4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:07.514246 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-92d45513-7e4a-467b-b6cb-e7845b6b86b4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:07.514874 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-92d45513-7e4a-467b-b6cb-e7845b6b86b4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:07.604855 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-92d45513-7e4a-467b-b6cb-e7845b6b86b4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:07.626847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-92d45513-7e4a-467b-b6cb-e7845b6b86b4 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1458 microversion: 2.1 time: 0.135888 Jul 28 04:01:07.627675 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 166/321] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:07 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1458 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:07.660235 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-ce17fce9-0505-4dfb-91ed-eb989a17c810 req-7ec0495b-d23b-459c-a0e9-1d535dd81293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bfe516-260b-44cc-b78b-6dfc94941c45", "name": "network-vif-deleted", "tag": "d0a469e8-d1be-42d4-a869-5bac46b69fd5"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:07.673273 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-ce17fce9-0505-4dfb-91ed-eb989a17c810 req-7ec0495b-d23b-459c-a0e9-1d535dd81293 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:07.673710 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-ce17fce9-0505-4dfb-91ed-eb989a17c810 req-7ec0495b-d23b-459c-a0e9-1d535dd81293 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:07.686589 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-ce17fce9-0505-4dfb-91ed-eb989a17c810 req-7ec0495b-d23b-459c-a0e9-1d535dd81293 service nova] Creating event network-vif-deleted:d0a469e8-d1be-42d4-a869-5bac46b69fd5 for instance f7bfe516-260b-44cc-b78b-6dfc94941c45 on hv-cinder-85127 Jul 28 04:01:07.692155 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-ce17fce9-0505-4dfb-91ed-eb989a17c810 req-7ec0495b-d23b-459c-a0e9-1d535dd81293 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035617 Jul 28 04:01:07.692835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 156/322] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:07.954621 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d066a88e-117f-4e49-8775-782654a0ecaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:07.967778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d066a88e-117f-4e49-8775-782654a0ecaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:07.969172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d066a88e-117f-4e49-8775-782654a0ecaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.037726 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:08.039146 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:08.055671 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.063329 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.069242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.070128 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.111900 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d066a88e-117f-4e49-8775-782654a0ecaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Going to try to stop instance {{(pid=135703) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:01:08.296290 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:08.304622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:08.307081 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:08.308460 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4bb6a7ff-0b11-4fa4-b46a-192dbb8f420c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.285476 Jul 28 04:01:08.309161 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 157/323] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:08 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:08.394119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d066a88e-117f-4e49-8775-782654a0ecaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.442938 Jul 28 04:01:08.396082 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 167/324] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:01:07 2022] POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:01:08.406331 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f2d81cf9-f5d9-4c07-99be-d60150466f6d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:08.407294 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f2d81cf9-f5d9-4c07-99be-d60150466f6d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:08.422826 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2d81cf9-f5d9-4c07-99be-d60150466f6d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.423612 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2d81cf9-f5d9-4c07-99be-d60150466f6d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.424570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2d81cf9-f5d9-4c07-99be-d60150466f6d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.425216 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2d81cf9-f5d9-4c07-99be-d60150466f6d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.648986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:08.649875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:08.665847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.666401 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.667501 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.668936 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.716491 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.717189 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.717897 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lazy-loading 'fault' on Instance uuid f7bfe516-260b-44cc-b78b-6dfc94941c45 {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:01:08.772451 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:08.788000 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a0a8aaf3-5504-40d6-84a3-94287d006702 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 200 len: 1303 microversion: 2.1 time: 0.143683 Jul 28 04:01:08.802141 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 168/325] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:08 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:08.970445 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f2d81cf9-f5d9-4c07-99be-d60150466f6d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:08.983628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f2d81cf9-f5d9-4c07-99be-d60150466f6d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.582265 Jul 28 04:01:08.984700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 158/326] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:08 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:09.332403 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:09.333276 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:09.341234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.341929 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.343145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.343614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.402385 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1922553817", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4531d3b7-3c72-4c16-9fba-50470f633af2"}], "security_groups": [{"name": "tempest-securitygroup--1990331468"}], "key_name": "tempest-keypair-1414986290", "user_data": "}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:09.529987 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:09.535352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:09.541689 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.network.neutron [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] validate_networks() for [('4531d3b7-3c72-4c16-9fba-50470f633af2', None, None, None, None, None)] {{(pid=135704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:01:09.542130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:09.544459 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:09.546926 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-825eb08f-633b-4ab3-94d7-7302fddcc360 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.218695 Jul 28 04:01:09.554483 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 169/327] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:09 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:09.710687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-4291953b-7fcb-4ebb-9f60-80689ec9164f req-c9f6b355-7e15-46ca-92fc-526597b5ccf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed19419-f0b9-473d-93cb-fefb8c29d74e", "tag": "68bf49ef-5416-40a1-b99b-f3cd17caa288"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:09.732314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-4291953b-7fcb-4ebb-9f60-80689ec9164f req-c9f6b355-7e15-46ca-92fc-526597b5ccf8 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.733391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-4291953b-7fcb-4ebb-9f60-80689ec9164f req-c9f6b355-7e15-46ca-92fc-526597b5ccf8 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.767388 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-4291953b-7fcb-4ebb-9f60-80689ec9164f req-c9f6b355-7e15-46ca-92fc-526597b5ccf8 service nova] Creating event network-changed:68bf49ef-5416-40a1-b99b-f3cd17caa288 for instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e on hv-cinder-85127 Jul 28 04:01:09.778546 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-4291953b-7fcb-4ebb-9f60-80689ec9164f req-c9f6b355-7e15-46ca-92fc-526597b5ccf8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072482 Jul 28 04:01:09.782427 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 170/328] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:09.810234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:09.811159 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: f7bfe516-260b-44cc-b78b-6dfc94941c45] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:09.824559 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.830261 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.831410 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.831878 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.848710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] HTTP exception thrown: Instance f7bfe516-260b-44cc-b78b-6dfc94941c45 could not be found. Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Request method failure captured: Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 HTTP/1.1 Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gnm7KBSmH_WFcgECLHkBVM-LoKwzfMmPAtDc-XwAwhFwX2jUAKIbZ1ESjkA-5mt8BCHK-dR1wPOZ12UMCHmgJDdViZNE09zvzft0JXd7QyLSiOwTqJIkgiNuUekDJdnaFK5WSJOMgS1AL7zm8UJ3-zXOTi9umuxoQcdlMFS87LzxgA Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 7041d959d23d41c58ac1f68559a14647 Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-VolumesActionsTest-1317926626 Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:01:09.850393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7041d959d23d41c58ac1f68559a14647", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7041d959d23d41c58ac1f68559a14647"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7041d959d23d41c58ac1f68559a14647"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7041d959d23d41c58ac1f68559a14647"}]}] Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-VolumesActionsTest-1317926626 Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 7041d959d23d41c58ac1f68559a14647 Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-VolumesActionsTest-1317926626 Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-VolumesActionsTest-1317926626-project Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: dc5a6050226a4e03b027bc8006e90df6 Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-VolumesActionsTest-1317926626-project Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance f7bfe516-260b-44cc-b78b-6dfc94941c45 could not be found. Jul 28 04:01:09.852351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': 'f7bfe516-260b-44cc-b78b-6dfc94941c45'} Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7bfe516-260b-44cc-b78b-6dfc94941c45 could not be found. Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:01:09.853121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7bfe516-260b-44cc-b78b-6dfc94941c45 could not be found. Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7bfe516-260b-44cc-b78b-6dfc94941c45 could not be found. Jul 28 04:01:09.854920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:01:09.856869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Returning 404 to user: Instance f7bfe516-260b-44cc-b78b-6dfc94941c45 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:01:09.856869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-40f0171a-0a52-4e7b-aecd-3a2f1ce69d9d tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45" status: 404 len: 111 microversion: 2.1 time: 0.046779 Jul 28 04:01:09.856869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 171/329] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:09 2022] GET /compute/v2.1/servers/f7bfe516-260b-44cc-b78b-6dfc94941c45 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:01:10.014456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-43877a19-91c3-4d0e-b0a6-1e4023fb287f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:10.015698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-43877a19-91c3-4d0e-b0a6-1e4023fb287f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:10.033642 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-43877a19-91c3-4d0e-b0a6-1e4023fb287f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.034090 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-43877a19-91c3-4d0e-b0a6-1e4023fb287f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.035245 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-43877a19-91c3-4d0e-b0a6-1e4023fb287f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.035879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-43877a19-91c3-4d0e-b0a6-1e4023fb287f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.210138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-43877a19-91c3-4d0e-b0a6-1e4023fb287f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:10.221314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-43877a19-91c3-4d0e-b0a6-1e4023fb287f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.214167 Jul 28 04:01:10.221897 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 172/330] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:10 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:10.239686 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1532838605", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "networks": [{"uuid": "4b26df26-f527-4a68-b490-7db3cb955d7b"}]}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:10.315322 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] validate_networks() for [('4b26df26-f527-4a68-b490-7db3cb955d7b', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:01:10.392676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Flavor limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:01:10.393899 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Image limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:01:10.395477 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Flavor pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:01:10.396256 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Image pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:01:10.397551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:01:10.411776 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.413280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.414594 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.415546 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.443160 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Getting quotas for project 8bf7f0f7880a435ba552361bcb31ef91. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:01:10.450251 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Getting quotas for user 4251e84650f047c9a6eb0c3b16b25564 and project 8bf7f0f7880a435ba552361bcb31ef91. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:01:10.466476 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Going to run 1 instances... {{(pid=135704) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:01:10.469446 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:01:10.631397 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a9b41ac3-73f3-446c-81c7-d6db825cd14a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.234661 Jul 28 04:01:10.632482 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 159/331] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:01:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:01:10.638151 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:10.639245 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:10.646848 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.649531 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.649700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.650526 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.839331 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:10.849316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:10.851012 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:10.852868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-41ebc329-8c32-45f5-a169-1907cb68c6ed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.218946 Jul 28 04:01:10.853443 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 160/332] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:10 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:10.858047 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ee01b2fe-1a35-4735-aec6-ea23e73fcd03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:10.858660 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ee01b2fe-1a35-4735-aec6-ea23e73fcd03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:10.870808 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:01:10.871798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:01:10.872461 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:01:10.875779 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:01:10.875779 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:01:10.885261 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.885909 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.887633 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.888278 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.915746 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Getting quotas for project 7041d959d23d41c58ac1f68559a14647. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:01:10.917965 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ee01b2fe-1a35-4735-aec6-ea23e73fcd03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:10.921451 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Getting quotas for user dc5a6050226a4e03b027bc8006e90df6 and project 7041d959d23d41c58ac1f68559a14647. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:01:10.926380 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ee01b2fe-1a35-4735-aec6-ea23e73fcd03 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1246 microversion: 2.1 time: 0.071864 Jul 28 04:01:10.927094 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 161/333] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:10 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:10.935499 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:01:10.937759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:01:11.100931 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-551036b7-2d85-41b2-8230-186c6706bf54 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867338 Jul 28 04:01:11.101517 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 173/334] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:01:11.113143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a6a0eb72-7c64-46f3-92e3-1717f5b68edb tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:11.113855 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a6a0eb72-7c64-46f3-92e3-1717f5b68edb tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:11.173353 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a6a0eb72-7c64-46f3-92e3-1717f5b68edb tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:11.183412 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a6a0eb72-7c64-46f3-92e3-1717f5b68edb tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1214 microversion: 2.1 time: 0.073798 Jul 28 04:01:11.188229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 162/335] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:11 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:11.251030 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d60fa044-64cb-4b81-9c88-b8405d37ddce tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:11.251030 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d60fa044-64cb-4b81-9c88-b8405d37ddce tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:11.258319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d60fa044-64cb-4b81-9c88-b8405d37ddce tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.258947 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d60fa044-64cb-4b81-9c88-b8405d37ddce tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:11.259766 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d60fa044-64cb-4b81-9c88-b8405d37ddce tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.260234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d60fa044-64cb-4b81-9c88-b8405d37ddce tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:11.404504 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d60fa044-64cb-4b81-9c88-b8405d37ddce tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:11.413608 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d60fa044-64cb-4b81-9c88-b8405d37ddce tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.169079 Jul 28 04:01:11.414228 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 174/336] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:11 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:11.876078 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:11.876802 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:11.883338 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.883903 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:11.884762 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.885347 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:11.950982 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0ed3a821-55f5-4dda-b878-3ed0dc3cf38a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:11.951601 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0ed3a821-55f5-4dda-b878-3ed0dc3cf38a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:11.958400 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ed3a821-55f5-4dda-b878-3ed0dc3cf38a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.959050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ed3a821-55f5-4dda-b878-3ed0dc3cf38a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:11.959853 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ed3a821-55f5-4dda-b878-3ed0dc3cf38a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.960361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ed3a821-55f5-4dda-b878-3ed0dc3cf38a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.027181 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.035915 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0ed3a821-55f5-4dda-b878-3ed0dc3cf38a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.040927 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.043441 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.044692 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b6a1ce25-dc2b-45d7-88ec-60ea3dcc3851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.172881 Jul 28 04:01:12.045310 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 163/337] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:11 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:12.046786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0ed3a821-55f5-4dda-b878-3ed0dc3cf38a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1250 microversion: 2.1 time: 0.100348 Jul 28 04:01:12.047358 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 175/338] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:11 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1250 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:12.204919 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c15a5c03-afc0-4422-835d-8f3fb1e6ce06 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:12.205550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c15a5c03-afc0-4422-835d-8f3fb1e6ce06 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:12.207517 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:12.212567 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c15a5c03-afc0-4422-835d-8f3fb1e6ce06 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.213022 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c15a5c03-afc0-4422-835d-8f3fb1e6ce06 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.213807 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c15a5c03-afc0-4422-835d-8f3fb1e6ce06 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.214247 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c15a5c03-afc0-4422-835d-8f3fb1e6ce06 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.280999 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c15a5c03-afc0-4422-835d-8f3fb1e6ce06 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.288991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c15a5c03-afc0-4422-835d-8f3fb1e6ce06 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1218 microversion: 2.1 time: 0.088063 Jul 28 04:01:12.289557 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 164/339] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:12 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:12.436011 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5bfa9001-fa6f-498d-98f2-65ce7b064860 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:12.436633 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5bfa9001-fa6f-498d-98f2-65ce7b064860 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:12.443108 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bfa9001-fa6f-498d-98f2-65ce7b064860 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.443561 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bfa9001-fa6f-498d-98f2-65ce7b064860 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.444378 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bfa9001-fa6f-498d-98f2-65ce7b064860 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.444818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bfa9001-fa6f-498d-98f2-65ce7b064860 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.583186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5bfa9001-fa6f-498d-98f2-65ce7b064860 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.591419 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5bfa9001-fa6f-498d-98f2-65ce7b064860 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.160291 Jul 28 04:01:12.592130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 176/340] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:12 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:13.070642 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:13.071068 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:13.077067 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2c755d73-2c93-4f33-ae9a-06f7bce62d5e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:13.077732 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2c755d73-2c93-4f33-ae9a-06f7bce62d5e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:13.080554 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.081052 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.081969 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.082593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.085094 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2c755d73-2c93-4f33-ae9a-06f7bce62d5e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.085669 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2c755d73-2c93-4f33-ae9a-06f7bce62d5e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.086351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2c755d73-2c93-4f33-ae9a-06f7bce62d5e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.086798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2c755d73-2c93-4f33-ae9a-06f7bce62d5e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.238554 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:13.247383 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:13.249221 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:13.250504 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4e80a6e6-4454-4cc6-8ec8-8e1efb5452b8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.184718 Jul 28 04:01:13.251082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 165/341] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:13 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:13.310365 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-08f53dc2-d6e7-453c-8849-16cb322089b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:13.311106 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-08f53dc2-d6e7-453c-8849-16cb322089b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:13.317621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08f53dc2-d6e7-453c-8849-16cb322089b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.318109 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08f53dc2-d6e7-453c-8849-16cb322089b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.318866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08f53dc2-d6e7-453c-8849-16cb322089b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.319312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08f53dc2-d6e7-453c-8849-16cb322089b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.387713 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-08f53dc2-d6e7-453c-8849-16cb322089b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:13.389727 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2c755d73-2c93-4f33-ae9a-06f7bce62d5e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:13.395363 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-08f53dc2-d6e7-453c-8849-16cb322089b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1266 microversion: 2.1 time: 0.089592 Jul 28 04:01:13.395987 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 166/342] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:13 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:13.401024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2c755d73-2c93-4f33-ae9a-06f7bce62d5e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1298 microversion: 2.1 time: 0.327633 Jul 28 04:01:13.401729 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 177/343] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:13 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1298 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:13.612733 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-960d36f5-59c0-4559-a5bb-3022dcaef359 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:13.613353 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-960d36f5-59c0-4559-a5bb-3022dcaef359 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:13.620037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-960d36f5-59c0-4559-a5bb-3022dcaef359 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.620502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-960d36f5-59c0-4559-a5bb-3022dcaef359 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.621288 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-960d36f5-59c0-4559-a5bb-3022dcaef359 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.621826 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-960d36f5-59c0-4559-a5bb-3022dcaef359 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.886683 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-960d36f5-59c0-4559-a5bb-3022dcaef359 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:13.897249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-960d36f5-59c0-4559-a5bb-3022dcaef359 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.288346 Jul 28 04:01:13.898046 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 167/344] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:13 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:14.276409 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:14.277027 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:14.283687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.284107 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.288859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.288859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.419205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e2154369-dac4-4a15-b8d6-1d7f4add4b30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:14.420015 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e2154369-dac4-4a15-b8d6-1d7f4add4b30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:14.433634 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e2154369-dac4-4a15-b8d6-1d7f4add4b30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.437113 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e2154369-dac4-4a15-b8d6-1d7f4add4b30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.438725 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e2154369-dac4-4a15-b8d6-1d7f4add4b30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.440229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e2154369-dac4-4a15-b8d6-1d7f4add4b30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.538599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:14.549079 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:14.551042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:14.552594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7b77f64e-aed6-400c-b01b-421a91fb876a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.280750 Jul 28 04:01:14.553686 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 178/345] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:14 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:14.560058 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bd1d4ea7-3005-4765-a56d-d884f9c73045 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:14.560970 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-bd1d4ea7-3005-4765-a56d-d884f9c73045 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:14.573662 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd1d4ea7-3005-4765-a56d-d884f9c73045 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.574573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd1d4ea7-3005-4765-a56d-d884f9c73045 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.575684 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd1d4ea7-3005-4765-a56d-d884f9c73045 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.575997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e2154369-dac4-4a15-b8d6-1d7f4add4b30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:14.576436 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd1d4ea7-3005-4765-a56d-d884f9c73045 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.595628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e2154369-dac4-4a15-b8d6-1d7f4add4b30 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1284 microversion: 2.1 time: 0.182177 Jul 28 04:01:14.600934 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 168/346] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:14 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:14.669781 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-bd1d4ea7-3005-4765-a56d-d884f9c73045 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:14.678086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-bd1d4ea7-3005-4765-a56d-d884f9c73045 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1304 microversion: 2.1 time: 0.123041 Jul 28 04:01:14.679100 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 179/347] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:14 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:14.919109 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f41902a2-fd22-4238-8646-d99347e9fbaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:14.919722 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f41902a2-fd22-4238-8646-d99347e9fbaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:14.926745 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f41902a2-fd22-4238-8646-d99347e9fbaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.927599 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f41902a2-fd22-4238-8646-d99347e9fbaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.928667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f41902a2-fd22-4238-8646-d99347e9fbaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.930539 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f41902a2-fd22-4238-8646-d99347e9fbaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.246879 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f41902a2-fd22-4238-8646-d99347e9fbaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:15.265380 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f41902a2-fd22-4238-8646-d99347e9fbaa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.350413 Jul 28 04:01:15.281138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 169/348] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:14 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:15.582842 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:15.583720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:15.592912 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.593474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.594302 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.594801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.616472 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-75c2234b-c451-4b9f-a919-72532bd47146 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:15.617092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-75c2234b-c451-4b9f-a919-72532bd47146 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:15.624933 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-75c2234b-c451-4b9f-a919-72532bd47146 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.625388 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-75c2234b-c451-4b9f-a919-72532bd47146 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.626177 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-75c2234b-c451-4b9f-a919-72532bd47146 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.626624 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-75c2234b-c451-4b9f-a919-72532bd47146 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.741051 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:15.750826 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:15.752349 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:15.753523 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d296289f-5dfd-48e8-b122-8d1de0aa8ef4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.176142 Jul 28 04:01:15.754084 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 180/349] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:15 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:15.759042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c0af124f-b8cc-46cb-83ad-ba79193098c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:15.759858 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c0af124f-b8cc-46cb-83ad-ba79193098c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:15.766748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c0af124f-b8cc-46cb-83ad-ba79193098c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.767211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c0af124f-b8cc-46cb-83ad-ba79193098c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.767935 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-75c2234b-c451-4b9f-a919-72532bd47146 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:15.768134 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c0af124f-b8cc-46cb-83ad-ba79193098c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.768499 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c0af124f-b8cc-46cb-83ad-ba79193098c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.777093 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-75c2234b-c451-4b9f-a919-72532bd47146 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1314 microversion: 2.1 time: 0.164419 Jul 28 04:01:15.777966 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 170/350] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:15 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:15.913875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c0af124f-b8cc-46cb-83ad-ba79193098c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:15.925516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c0af124f-b8cc-46cb-83ad-ba79193098c4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.168949 Jul 28 04:01:15.925516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 181/351] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:15 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:16.289822 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-65dbbf39-01a1-4a06-8419-a6d21c609655 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:16.291114 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-65dbbf39-01a1-4a06-8419-a6d21c609655 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:16.298089 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65dbbf39-01a1-4a06-8419-a6d21c609655 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:16.298639 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65dbbf39-01a1-4a06-8419-a6d21c609655 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:16.299645 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65dbbf39-01a1-4a06-8419-a6d21c609655 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:16.300130 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65dbbf39-01a1-4a06-8419-a6d21c609655 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:16.523766 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1f5e3577-f04f-482b-a1e0-a09a266f9d37 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: .version_select at 0x7f55782f3af0>, body: {"keypair": {"name": "tempest-keypair-137906234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqbqPLSoNjHhFdsKdlFmXDVZYxSfxMIDAYPhvXRIEpS/mdGMZXRXLfaNxn9G0uvatej02eH14MNYaRQ74AHJUoLx+bZguSegpi6DaT1vr1ectM55Xp+gr8J7vNk2NwMQA=="}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:16.541296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-1f5e3577-f04f-482b-a1e0-a09a266f9d37 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for project f68fb083db524ab59ba49d71ae754ba0. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:01:16.545361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-1f5e3577-f04f-482b-a1e0-a09a266f9d37 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for user 37b7380889a4411cb57465ab5d33ba75 and project f68fb083db524ab59ba49d71ae754ba0. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:01:16.637408 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1f5e3577-f04f-482b-a1e0-a09a266f9d37 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117566 Jul 28 04:01:16.638043 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 182/352] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 04:01:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:16.720430 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-65dbbf39-01a1-4a06-8419-a6d21c609655 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:16.729184 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-65dbbf39-01a1-4a06-8419-a6d21c609655 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.444163 Jul 28 04:01:16.729765 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 171/353] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:16 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:16.778548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:16.779284 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:16.786829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:16.787545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:16.788361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:16.789033 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:16.804691 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-08a5c636-0763-4b5b-847e-2b8efce47b84 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:16.805525 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-08a5c636-0763-4b5b-847e-2b8efce47b84 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:16.819090 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08a5c636-0763-4b5b-847e-2b8efce47b84 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:16.820518 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08a5c636-0763-4b5b-847e-2b8efce47b84 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:16.822723 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08a5c636-0763-4b5b-847e-2b8efce47b84 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:16.823611 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08a5c636-0763-4b5b-847e-2b8efce47b84 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:16.975054 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:16.985050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:16.986815 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:16.988148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-73193442-fa25-4a4a-a7a6-1b0cb24001ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.214742 Jul 28 04:01:16.992722 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 183/354] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:16 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:16.998556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aad76eb1-100c-40f9-b53a-574c036bee22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:16.999232 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-aad76eb1-100c-40f9-b53a-574c036bee22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:17.005803 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aad76eb1-100c-40f9-b53a-574c036bee22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:17.006278 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aad76eb1-100c-40f9-b53a-574c036bee22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:17.007058 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aad76eb1-100c-40f9-b53a-574c036bee22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:17.007502 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aad76eb1-100c-40f9-b53a-574c036bee22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:17.161419 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-08a5c636-0763-4b5b-847e-2b8efce47b84 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:17.161559 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aad76eb1-100c-40f9-b53a-574c036bee22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:17.165320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-08a5c636-0763-4b5b-847e-2b8efce47b84 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1314 microversion: 2.1 time: 0.366398 Jul 28 04:01:17.178376 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 172/355] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:16 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:17.182810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-aad76eb1-100c-40f9-b53a-574c036bee22 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.188936 Jul 28 04:01:17.183406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 184/356] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:16 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:17.750394 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f9fb382b-e12e-4f88-8e1e-23d6b384da54 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:17.751019 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f9fb382b-e12e-4f88-8e1e-23d6b384da54 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:17.758068 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f9fb382b-e12e-4f88-8e1e-23d6b384da54 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:17.758877 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f9fb382b-e12e-4f88-8e1e-23d6b384da54 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:17.760293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f9fb382b-e12e-4f88-8e1e-23d6b384da54 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:17.761104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f9fb382b-e12e-4f88-8e1e-23d6b384da54 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:17.828053 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-de891d2d-6e13-474d-b445-6c7b2b822e8a req-a014d61f-2fc5-4861-8bf0-6a138bfac94f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77990c1b-5f6b-4da2-9963-9507f1e0f714", "tag": "2f24ff08-75ca-4140-bda6-14f798181200"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:17.856462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-de891d2d-6e13-474d-b445-6c7b2b822e8a req-a014d61f-2fc5-4861-8bf0-6a138bfac94f service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:17.860061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-de891d2d-6e13-474d-b445-6c7b2b822e8a req-a014d61f-2fc5-4861-8bf0-6a138bfac94f service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:17.881608 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-de891d2d-6e13-474d-b445-6c7b2b822e8a req-a014d61f-2fc5-4861-8bf0-6a138bfac94f service nova] Creating event network-changed:2f24ff08-75ca-4140-bda6-14f798181200 for instance 77990c1b-5f6b-4da2-9963-9507f1e0f714 on hv-cinder-85127 Jul 28 04:01:17.891149 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-de891d2d-6e13-474d-b445-6c7b2b822e8a req-a014d61f-2fc5-4861-8bf0-6a138bfac94f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067031 Jul 28 04:01:17.892871 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 185/357] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:18.014568 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:18.015812 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:18.023774 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.026759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.031707 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.034428 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.267257 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f9fb382b-e12e-4f88-8e1e-23d6b384da54 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:18.278509 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f9fb382b-e12e-4f88-8e1e-23d6b384da54 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.531992 Jul 28 04:01:18.291807 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 173/358] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:17 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:18.291807 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-88036001-7fdb-4e19-b4db-dd86cae21171 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:18.291807 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-88036001-7fdb-4e19-b4db-dd86cae21171 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:18.293194 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-88036001-7fdb-4e19-b4db-dd86cae21171 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.294070 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-88036001-7fdb-4e19-b4db-dd86cae21171 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.295124 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-88036001-7fdb-4e19-b4db-dd86cae21171 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.295567 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-88036001-7fdb-4e19-b4db-dd86cae21171 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.348443 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:18.357359 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:18.359411 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:18.361138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-515ed493-43fe-4a36-8570-40e7946ae6f2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.352203 Jul 28 04:01:18.361730 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 186/359] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:18 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:18.367478 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-45fe87a1-1636-4ee9-9f8a-0ca00ec878c0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:18.368435 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-45fe87a1-1636-4ee9-9f8a-0ca00ec878c0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:18.383341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-45fe87a1-1636-4ee9-9f8a-0ca00ec878c0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.383806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-45fe87a1-1636-4ee9-9f8a-0ca00ec878c0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.385397 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-45fe87a1-1636-4ee9-9f8a-0ca00ec878c0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.385990 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-45fe87a1-1636-4ee9-9f8a-0ca00ec878c0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.678943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-88036001-7fdb-4e19-b4db-dd86cae21171 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:18.690789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-88036001-7fdb-4e19-b4db-dd86cae21171 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1314 microversion: 2.1 time: 0.410468 Jul 28 04:01:18.692493 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 174/360] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:18 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:18.699916 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-45fe87a1-1636-4ee9-9f8a-0ca00ec878c0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:18.711864 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-45fe87a1-1636-4ee9-9f8a-0ca00ec878c0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.348729 Jul 28 04:01:18.713502 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 187/361] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:18 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:19.302282 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b280b87a-8552-4f64-80cc-5ebbcc124451 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:19.302897 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b280b87a-8552-4f64-80cc-5ebbcc124451 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:19.309551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b280b87a-8552-4f64-80cc-5ebbcc124451 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.310021 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b280b87a-8552-4f64-80cc-5ebbcc124451 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.310787 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b280b87a-8552-4f64-80cc-5ebbcc124451 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.311231 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b280b87a-8552-4f64-80cc-5ebbcc124451 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.328988 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=100 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:19.387707 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:19.389094 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:19.397234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.398433 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.399120 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.399729 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.471483 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b280b87a-8552-4f64-80cc-5ebbcc124451 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:19.482446 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b280b87a-8552-4f64-80cc-5ebbcc124451 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.184122 Jul 28 04:01:19.493207 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 175/362] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:19 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:19.582832 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:19.593492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:19.595463 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:19.597212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6aff30a4-cd8b-45c7-912c-68b5a06a425d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1745 microversion: 2.20 time: 0.214403 Jul 28 04:01:19.605866 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 188/363] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:19 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:01:19.711721 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1756664373", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cf9021b-c509-4bfd-870b-1ff5c987c7dd"}], "security_groups": [{"name": "tempest-securitygroup--488375802"}], "key_name": "tempest-keypair-137906234", "user_data": "}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:19.714960 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aaaccaf4-8781-443c-b7d2-62f11650261c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:19.715590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-aaaccaf4-8781-443c-b7d2-62f11650261c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:19.725520 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aaaccaf4-8781-443c-b7d2-62f11650261c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.725800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aaaccaf4-8781-443c-b7d2-62f11650261c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.727297 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aaaccaf4-8781-443c-b7d2-62f11650261c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.727297 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aaaccaf4-8781-443c-b7d2-62f11650261c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.877808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.network.neutron [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] validate_networks() for [('9cf9021b-c509-4bfd-870b-1ff5c987c7dd', None, None, None, None, None)] {{(pid=135704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:01:19.945330 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aaaccaf4-8781-443c-b7d2-62f11650261c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:19.958693 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-aaaccaf4-8781-443c-b7d2-62f11650261c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1314 microversion: 2.1 time: 0.248904 Jul 28 04:01:19.959432 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 189/364] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:19 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:19.966809 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0943b7c0-ac61-4cc0-a799-4ff7dbd30b7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:19.969003 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0943b7c0-ac61-4cc0-a799-4ff7dbd30b7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:19.978702 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:19.987108 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0943b7c0-ac61-4cc0-a799-4ff7dbd30b7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.987732 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0943b7c0-ac61-4cc0-a799-4ff7dbd30b7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.988765 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0943b7c0-ac61-4cc0-a799-4ff7dbd30b7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.989337 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0943b7c0-ac61-4cc0-a799-4ff7dbd30b7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.001560 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=100 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:20.210155 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0943b7c0-ac61-4cc0-a799-4ff7dbd30b7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:20.223625 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0943b7c0-ac61-4cc0-a799-4ff7dbd30b7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.262368 Jul 28 04:01:20.225124 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 190/365] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:19 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:20.247161 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-bfdae34f-0cd0-4d5f-b6c1-4b1cad5fdb8a req-9322a9bd-5a59-4341-b194-6c7b0de33026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b", "tag": "d2c58462-fb66-479c-9106-a98477b390b4"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:20.263761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-bfdae34f-0cd0-4d5f-b6c1-4b1cad5fdb8a req-9322a9bd-5a59-4341-b194-6c7b0de33026 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.263761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-bfdae34f-0cd0-4d5f-b6c1-4b1cad5fdb8a req-9322a9bd-5a59-4341-b194-6c7b0de33026 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.277768 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-bfdae34f-0cd0-4d5f-b6c1-4b1cad5fdb8a req-9322a9bd-5a59-4341-b194-6c7b0de33026 service nova] Creating event network-changed:d2c58462-fb66-479c-9106-a98477b390b4 for instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b on hv-cinder-85127 Jul 28 04:01:20.283995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-bfdae34f-0cd0-4d5f-b6c1-4b1cad5fdb8a req-9322a9bd-5a59-4341-b194-6c7b0de33026 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045349 Jul 28 04:01:20.283995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 191/366] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:20.431721 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:20.461801 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Flavor limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:01:20.462221 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Image limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:01:20.462908 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Flavor pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:01:20.464245 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Image pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:01:20.464922 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:01:20.477586 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.478688 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.481795 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.483673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.516817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for project f68fb083db524ab59ba49d71ae754ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:01:20.522821 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for user 37b7380889a4411cb57465ab5d33ba75 and project f68fb083db524ab59ba49d71ae754ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:01:20.529855 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5afa712b-3976-41a2-ae42-b24d02d11d98 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:20.531178 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5afa712b-3976-41a2-ae42-b24d02d11d98 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:20.547716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5afa712b-3976-41a2-ae42-b24d02d11d98 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.548743 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5afa712b-3976-41a2-ae42-b24d02d11d98 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.550501 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Going to run 1 instances... {{(pid=135704) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:01:20.551150 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5afa712b-3976-41a2-ae42-b24d02d11d98 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.552319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5afa712b-3976-41a2-ae42-b24d02d11d98 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.553704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:01:20.718943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0e81d51c-8d86-40ef-a42b-5588d35ab027 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.011692 Jul 28 04:01:20.721155 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 176/367] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:01:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:01:20.737304 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:20.738363 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:20.768513 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5afa712b-3976-41a2-ae42-b24d02d11d98 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:20.768719 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.768719 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.775945 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.776810 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.781114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5afa712b-3976-41a2-ae42-b24d02d11d98 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.274983 Jul 28 04:01:20.782148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 192/368] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:20 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:20.788995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e168962d-1102-4944-b591-4acd7211d6d6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:20.790267 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e168962d-1102-4944-b591-4acd7211d6d6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:20.872031 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-e168962d-1102-4944-b591-4acd7211d6d6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:20.884587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e168962d-1102-4944-b591-4acd7211d6d6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1241 microversion: 2.1 time: 0.100751 Jul 28 04:01:20.886819 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 193/369] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:20 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:20.986494 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-94616b04-e24d-46c8-83e6-3500217c67dd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:20.987521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-94616b04-e24d-46c8-83e6-3500217c67dd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:21.005163 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:21.010583 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-94616b04-e24d-46c8-83e6-3500217c67dd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.017608 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-94616b04-e24d-46c8-83e6-3500217c67dd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.018488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-94616b04-e24d-46c8-83e6-3500217c67dd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.018945 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-94616b04-e24d-46c8-83e6-3500217c67dd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.050435 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:21.067762 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:21.070631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:21.072697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-500dc468-cdab-453c-be57-2db05f8b7fa6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1745 microversion: 2.20 time: 0.347401 Jul 28 04:01:21.073373 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 177/370] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:20 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1745 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:21.205295 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-94616b04-e24d-46c8-83e6-3500217c67dd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:21.220006 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-94616b04-e24d-46c8-83e6-3500217c67dd tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1314 microversion: 2.1 time: 0.239913 Jul 28 04:01:21.220723 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 194/371] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:20 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:21.250393 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8f4ae2be-9f84-40c3-a667-96f3674764a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:21.251209 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8f4ae2be-9f84-40c3-a667-96f3674764a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:21.258768 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8f4ae2be-9f84-40c3-a667-96f3674764a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.259325 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8f4ae2be-9f84-40c3-a667-96f3674764a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.260494 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8f4ae2be-9f84-40c3-a667-96f3674764a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.261005 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8f4ae2be-9f84-40c3-a667-96f3674764a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.411820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8f4ae2be-9f84-40c3-a667-96f3674764a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:21.420140 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8f4ae2be-9f84-40c3-a667-96f3674764a1 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.173988 Jul 28 04:01:21.420734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 178/372] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:21 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:21.814196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-208f8899-b64a-423d-9fef-35ad710edeea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:21.814824 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-208f8899-b64a-423d-9fef-35ad710edeea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:21.823101 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-208f8899-b64a-423d-9fef-35ad710edeea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.823565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-208f8899-b64a-423d-9fef-35ad710edeea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.824407 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-208f8899-b64a-423d-9fef-35ad710edeea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.824862 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-208f8899-b64a-423d-9fef-35ad710edeea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.928560 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e4b0cabf-a3bd-4247-a21a-37f97c69b680 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:21.930250 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e4b0cabf-a3bd-4247-a21a-37f97c69b680 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:21.939688 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4b0cabf-a3bd-4247-a21a-37f97c69b680 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.940653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4b0cabf-a3bd-4247-a21a-37f97c69b680 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.942053 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4b0cabf-a3bd-4247-a21a-37f97c69b680 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.943283 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4b0cabf-a3bd-4247-a21a-37f97c69b680 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.038717 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-208f8899-b64a-423d-9fef-35ad710edeea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:22.060750 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-208f8899-b64a-423d-9fef-35ad710edeea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.249509 Jul 28 04:01:22.072416 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 195/373] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:21 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:22.102144 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:22.102877 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:22.112726 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.113316 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.114292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.114850 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.116932 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e4b0cabf-a3bd-4247-a21a-37f97c69b680 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:22.176923 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e4b0cabf-a3bd-4247-a21a-37f97c69b680 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1245 microversion: 2.1 time: 0.253047 Jul 28 04:01:22.179653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 179/374] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:21 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1245 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:22.244336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0fd2db11-d2b9-4655-a1e8-6ccfb71a862c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:22.245528 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0fd2db11-d2b9-4655-a1e8-6ccfb71a862c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:22.256254 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fd2db11-d2b9-4655-a1e8-6ccfb71a862c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.275549 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fd2db11-d2b9-4655-a1e8-6ccfb71a862c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.276360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fd2db11-d2b9-4655-a1e8-6ccfb71a862c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.276835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fd2db11-d2b9-4655-a1e8-6ccfb71a862c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.426739 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:22.438488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:22.452628 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:22.452628 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-73ea468a-f399-4bab-81a3-5d2831b2ed72 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1745 microversion: 2.20 time: 0.343952 Jul 28 04:01:22.452628 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 196/375] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:22 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1745 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:01:22.461732 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a2f66ad2-bf64-40fb-91f2-be482dedf0af tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:22.462559 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a2f66ad2-bf64-40fb-91f2-be482dedf0af tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:22.483859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2f66ad2-bf64-40fb-91f2-be482dedf0af tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.486477 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2f66ad2-bf64-40fb-91f2-be482dedf0af tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.488167 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2f66ad2-bf64-40fb-91f2-be482dedf0af tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.489068 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a2f66ad2-bf64-40fb-91f2-be482dedf0af tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.742206 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0fd2db11-d2b9-4655-a1e8-6ccfb71a862c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:22.751071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0fd2db11-d2b9-4655-a1e8-6ccfb71a862c tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1314 microversion: 2.1 time: 0.511649 Jul 28 04:01:22.764439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 180/376] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:22 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:22.769462 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-4149b649-8a9d-4a55-8869-f2e95d08bd95 req-e2cafea9-c171-45df-ac2d-7294908f1900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eadfe50-2ab9-46dc-be42-b9496e4008ac", "name": "network-vif-plugged", "status": "completed", "tag": "ef1e8289-929e-424e-b1c1-98a45ed868ea"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:22.793656 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-4149b649-8a9d-4a55-8869-f2e95d08bd95 req-e2cafea9-c171-45df-ac2d-7294908f1900 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.794106 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-4149b649-8a9d-4a55-8869-f2e95d08bd95 req-e2cafea9-c171-45df-ac2d-7294908f1900 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.831584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-4149b649-8a9d-4a55-8869-f2e95d08bd95 req-e2cafea9-c171-45df-ac2d-7294908f1900 service nova] Creating event network-vif-plugged:ef1e8289-929e-424e-b1c1-98a45ed868ea for instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac on hv-cinder-85127 Jul 28 04:01:22.841064 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-4149b649-8a9d-4a55-8869-f2e95d08bd95 req-e2cafea9-c171-45df-ac2d-7294908f1900 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075292 Jul 28 04:01:22.846988 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 181/377] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:22.865501 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a2f66ad2-bf64-40fb-91f2-be482dedf0af tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:22.878676 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a2f66ad2-bf64-40fb-91f2-be482dedf0af tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.424493 Jul 28 04:01:22.882272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 197/378] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:22 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:23.084377 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2d3a3525-c672-4934-aff5-a01861afbaa5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:23.085916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2d3a3525-c672-4934-aff5-a01861afbaa5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:23.094036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d3a3525-c672-4934-aff5-a01861afbaa5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.095302 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d3a3525-c672-4934-aff5-a01861afbaa5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.096617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d3a3525-c672-4934-aff5-a01861afbaa5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.098093 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2d3a3525-c672-4934-aff5-a01861afbaa5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.201759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3c8c82a9-0dc7-4cba-b72b-20fdbcb8f594 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:23.203055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3c8c82a9-0dc7-4cba-b72b-20fdbcb8f594 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:23.214328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3c8c82a9-0dc7-4cba-b72b-20fdbcb8f594 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.214880 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3c8c82a9-0dc7-4cba-b72b-20fdbcb8f594 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.215746 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3c8c82a9-0dc7-4cba-b72b-20fdbcb8f594 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.216283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3c8c82a9-0dc7-4cba-b72b-20fdbcb8f594 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.345537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3c8c82a9-0dc7-4cba-b72b-20fdbcb8f594 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:23.355211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3c8c82a9-0dc7-4cba-b72b-20fdbcb8f594 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1293 microversion: 2.1 time: 0.159149 Jul 28 04:01:23.356202 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 198/379] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:23 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:23.433513 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2d3a3525-c672-4934-aff5-a01861afbaa5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:23.443863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2d3a3525-c672-4934-aff5-a01861afbaa5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1724 microversion: 2.1 time: 0.364940 Jul 28 04:01:23.445763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 182/380] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:23 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:23.484683 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:23.489292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:23.497283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.498752 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.500467 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.501537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.775424 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:23.784479 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:23.786119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:23.787490 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-76298b65-adfd-47ee-a917-529735698149 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.310081 Jul 28 04:01:23.804461 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 199/381] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:23 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:23.813151 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8ff93fea-9a7e-4e1a-8c48-7462014a6e16 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:23.814084 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8ff93fea-9a7e-4e1a-8c48-7462014a6e16 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:23.823743 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ff93fea-9a7e-4e1a-8c48-7462014a6e16 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.824635 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ff93fea-9a7e-4e1a-8c48-7462014a6e16 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.825726 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ff93fea-9a7e-4e1a-8c48-7462014a6e16 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.826430 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8ff93fea-9a7e-4e1a-8c48-7462014a6e16 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.903410 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d1076aeb-3618-440e-b2cd-95ebd925e40f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:23.904149 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d1076aeb-3618-440e-b2cd-95ebd925e40f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:23.920330 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d1076aeb-3618-440e-b2cd-95ebd925e40f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.920879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d1076aeb-3618-440e-b2cd-95ebd925e40f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.927312 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d1076aeb-3618-440e-b2cd-95ebd925e40f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.928265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d1076aeb-3618-440e-b2cd-95ebd925e40f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.302448 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d1076aeb-3618-440e-b2cd-95ebd925e40f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:24.312505 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d1076aeb-3618-440e-b2cd-95ebd925e40f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.413635 Jul 28 04:01:24.328061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 200/382] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:23 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:24.378130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d7f29734-44cc-4bfa-8659-e5a5697806cd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:24.379630 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d7f29734-44cc-4bfa-8659-e5a5697806cd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:24.394166 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d7f29734-44cc-4bfa-8659-e5a5697806cd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.403908 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d7f29734-44cc-4bfa-8659-e5a5697806cd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.405853 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d7f29734-44cc-4bfa-8659-e5a5697806cd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.420097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d7f29734-44cc-4bfa-8659-e5a5697806cd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.423597 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8ff93fea-9a7e-4e1a-8c48-7462014a6e16 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:24.446131 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8ff93fea-9a7e-4e1a-8c48-7462014a6e16 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1314 microversion: 2.1 time: 0.636593 Jul 28 04:01:24.453791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 183/383] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:23 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:24.483892 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-05fcf288-b393-4fd0-aec2-73b4aeb3ef51 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:24.485317 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-05fcf288-b393-4fd0-aec2-73b4aeb3ef51 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:24.511011 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05fcf288-b393-4fd0-aec2-73b4aeb3ef51 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.512019 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05fcf288-b393-4fd0-aec2-73b4aeb3ef51 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.514193 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05fcf288-b393-4fd0-aec2-73b4aeb3ef51 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.515256 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05fcf288-b393-4fd0-aec2-73b4aeb3ef51 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.518710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d7f29734-44cc-4bfa-8659-e5a5697806cd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:24.528834 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d7f29734-44cc-4bfa-8659-e5a5697806cd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1299 microversion: 2.1 time: 0.155031 Jul 28 04:01:24.529538 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 201/384] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:24 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:24.725692 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-05fcf288-b393-4fd0-aec2-73b4aeb3ef51 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:24.736900 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-05fcf288-b393-4fd0-aec2-73b4aeb3ef51 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1701 microversion: 2.1 time: 0.259577 Jul 28 04:01:24.742034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 184/385] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:24 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1701 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:24.760374 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-90758994-fa5b-44ac-88b1-4406e6762ff9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:24.768065 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-90758994-fa5b-44ac-88b1-4406e6762ff9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.768621 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-90758994-fa5b-44ac-88b1-4406e6762ff9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.808833 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-90758994-fa5b-44ac-88b1-4406e6762ff9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Going to try to start instance {{(pid=135703) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 04:01:24.817881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:24.819486 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:24.831622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.832844 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.834514 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.835299 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.060303 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:25.073494 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:25.076805 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:25.078971 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e4075ac7-bd4d-4c34-b21c-080b1dbafca0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.268489 Jul 28 04:01:25.080117 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 185/386] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:24 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:01:25.086098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-22717bef-0604-4fb7-8ea2-fe7f5e14c98a req-e24cbc8b-d4ff-4970-8d82-2c1ec720e3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77990c1b-5f6b-4da2-9963-9507f1e0f714", "name": "network-vif-plugged", "status": "completed", "tag": "2f24ff08-75ca-4140-bda6-14f798181200"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:25.102964 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-22717bef-0604-4fb7-8ea2-fe7f5e14c98a req-e24cbc8b-d4ff-4970-8d82-2c1ec720e3b7 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.104745 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-22717bef-0604-4fb7-8ea2-fe7f5e14c98a req-e24cbc8b-d4ff-4970-8d82-2c1ec720e3b7 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.119303 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-22717bef-0604-4fb7-8ea2-fe7f5e14c98a req-e24cbc8b-d4ff-4970-8d82-2c1ec720e3b7 service nova] Creating event network-vif-plugged:2f24ff08-75ca-4140-bda6-14f798181200 for instance 77990c1b-5f6b-4da2-9963-9507f1e0f714 on hv-cinder-85127 Jul 28 04:01:25.129335 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-22717bef-0604-4fb7-8ea2-fe7f5e14c98a req-e24cbc8b-d4ff-4970-8d82-2c1ec720e3b7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047474 Jul 28 04:01:25.130598 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 186/387] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:25.225265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-90758994-fa5b-44ac-88b1-4406e6762ff9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.468872 Jul 28 04:01:25.230073 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 202/388] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:01:24 2022] POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:01:25.238281 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e4ab38ba-f1be-4629-95f8-b49501dccd97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:25.239118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e4ab38ba-f1be-4629-95f8-b49501dccd97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:25.252466 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4ab38ba-f1be-4629-95f8-b49501dccd97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.255321 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4ab38ba-f1be-4629-95f8-b49501dccd97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.255321 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4ab38ba-f1be-4629-95f8-b49501dccd97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.258009 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e4ab38ba-f1be-4629-95f8-b49501dccd97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.334449 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d091b0b9-cd82-4ae2-b00c-3d2fc8f13a09 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:25.335832 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d091b0b9-cd82-4ae2-b00c-3d2fc8f13a09 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:25.345649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d091b0b9-cd82-4ae2-b00c-3d2fc8f13a09 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.346411 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d091b0b9-cd82-4ae2-b00c-3d2fc8f13a09 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.347485 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d091b0b9-cd82-4ae2-b00c-3d2fc8f13a09 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.348193 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d091b0b9-cd82-4ae2-b00c-3d2fc8f13a09 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.590250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d091b0b9-cd82-4ae2-b00c-3d2fc8f13a09 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:25.602338 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d091b0b9-cd82-4ae2-b00c-3d2fc8f13a09 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.272071 Jul 28 04:01:25.602796 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 203/389] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:25 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:25.610878 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ef1c020f-9b93-4cca-a1d4-8439e0886f2e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:25.611802 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ef1c020f-9b93-4cca-a1d4-8439e0886f2e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:25.618467 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ef1c020f-9b93-4cca-a1d4-8439e0886f2e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.620208 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ef1c020f-9b93-4cca-a1d4-8439e0886f2e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.621308 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ef1c020f-9b93-4cca-a1d4-8439e0886f2e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.622003 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ef1c020f-9b93-4cca-a1d4-8439e0886f2e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.796458 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e4ab38ba-f1be-4629-95f8-b49501dccd97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:25.809359 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e4ab38ba-f1be-4629-95f8-b49501dccd97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1710 microversion: 2.1 time: 0.576227 Jul 28 04:01:25.817667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 187/390] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:25 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1710 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:25.823120 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-159526b8-c0d3-479b-bf7f-1688950d238c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:25.826091 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-159526b8-c0d3-479b-bf7f-1688950d238c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:25.841798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ef1c020f-9b93-4cca-a1d4-8439e0886f2e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:25.849973 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ef1c020f-9b93-4cca-a1d4-8439e0886f2e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1314 microversion: 2.1 time: 0.245321 Jul 28 04:01:25.851536 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-159526b8-c0d3-479b-bf7f-1688950d238c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.852031 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-159526b8-c0d3-479b-bf7f-1688950d238c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.853230 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 204/391] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:25 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:25.872134 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-159526b8-c0d3-479b-bf7f-1688950d238c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.872134 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-159526b8-c0d3-479b-bf7f-1688950d238c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.076869 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-159526b8-c0d3-479b-bf7f-1688950d238c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:26.085239 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-159526b8-c0d3-479b-bf7f-1688950d238c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1299 microversion: 2.1 time: 0.266373 Jul 28 04:01:26.088987 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 188/392] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:25 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1299 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:26.105798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:26.105798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:26.112960 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.115651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.115651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.115651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.307764 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:26.318571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:26.320739 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:26.321412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6b4cdc44-c1d2-4db0-bc5f-7e1003b4ad7e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.221304 Jul 28 04:01:26.336423 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 205/393] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:26 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:26.640432 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-45804169-7c03-4554-a3b8-c714e66dde8a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:26.641409 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-45804169-7c03-4554-a3b8-c714e66dde8a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:26.649769 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-45804169-7c03-4554-a3b8-c714e66dde8a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.650896 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-45804169-7c03-4554-a3b8-c714e66dde8a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.651915 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-45804169-7c03-4554-a3b8-c714e66dde8a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.652546 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-45804169-7c03-4554-a3b8-c714e66dde8a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.837755 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-47c247bd-1e12-4bab-b0ed-cbbe4d7b4673 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:26.839352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-47c247bd-1e12-4bab-b0ed-cbbe4d7b4673 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:26.846642 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-45804169-7c03-4554-a3b8-c714e66dde8a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:26.855227 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-47c247bd-1e12-4bab-b0ed-cbbe4d7b4673 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.860170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-47c247bd-1e12-4bab-b0ed-cbbe4d7b4673 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.860170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-47c247bd-1e12-4bab-b0ed-cbbe4d7b4673 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.860170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-47c247bd-1e12-4bab-b0ed-cbbe4d7b4673 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.860474 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-45804169-7c03-4554-a3b8-c714e66dde8a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.223133 Jul 28 04:01:26.860474 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 189/394] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:26 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:26.883135 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1af9574a-2637-42da-9512-3759540f0209 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:26.884471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1af9574a-2637-42da-9512-3759540f0209 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:26.898178 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1af9574a-2637-42da-9512-3759540f0209 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.898178 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1af9574a-2637-42da-9512-3759540f0209 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.898178 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1af9574a-2637-42da-9512-3759540f0209 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.899024 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1af9574a-2637-42da-9512-3759540f0209 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.262192 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-47c247bd-1e12-4bab-b0ed-cbbe4d7b4673 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:27.262192 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-47c247bd-1e12-4bab-b0ed-cbbe4d7b4673 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1710 microversion: 2.1 time: 0.280506 Jul 28 04:01:27.262192 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 206/395] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:26 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1710 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:27.262192 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-cb26459a-463e-4b56-b7cb-d0aa1daa1a75 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:27.263462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-cb26459a-463e-4b56-b7cb-d0aa1daa1a75 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:27.263462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cb26459a-463e-4b56-b7cb-d0aa1daa1a75 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:27.263462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cb26459a-463e-4b56-b7cb-d0aa1daa1a75 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.263462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cb26459a-463e-4b56-b7cb-d0aa1daa1a75 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:27.264527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cb26459a-463e-4b56-b7cb-d0aa1daa1a75 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.264527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:27.310098 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cb26459a-463e-4b56-b7cb-d0aa1daa1a75 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:27.319359 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-cb26459a-463e-4b56-b7cb-d0aa1daa1a75 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.206720 Jul 28 04:01:27.320053 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 207/396] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:27 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:27.334775 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-132c0c7a-9c8f-458c-b181-cd9d03467728 req-597aa5f1-3124-433b-b81c-109e85a5cebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b", "name": "network-vif-plugged", "status": "completed", "tag": "d2c58462-fb66-479c-9106-a98477b390b4"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:27.345735 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-132c0c7a-9c8f-458c-b181-cd9d03467728 req-597aa5f1-3124-433b-b81c-109e85a5cebf service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:27.346418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-132c0c7a-9c8f-458c-b181-cd9d03467728 req-597aa5f1-3124-433b-b81c-109e85a5cebf service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.362892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-132c0c7a-9c8f-458c-b181-cd9d03467728 req-597aa5f1-3124-433b-b81c-109e85a5cebf service nova] Creating event network-vif-plugged:d2c58462-fb66-479c-9106-a98477b390b4 for instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b on hv-cinder-85127 Jul 28 04:01:27.370613 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-132c0c7a-9c8f-458c-b181-cd9d03467728 req-597aa5f1-3124-433b-b81c-109e85a5cebf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042330 Jul 28 04:01:27.371984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 208/397] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:27.376835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1af9574a-2637-42da-9512-3759540f0209 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:27.377559 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:27.378343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:27.386277 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1af9574a-2637-42da-9512-3759540f0209 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1314 microversion: 2.1 time: 0.509629 Jul 28 04:01:27.386535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:27.386935 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.402382 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 190/398] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:26 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:27.412097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:27.412097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.590875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:27.601156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:27.609687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:27.612365 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-01bc50ac-f16a-49ca-866f-1cb79ee50faa tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.238367 Jul 28 04:01:27.612986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 209/399] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:27 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:27.886375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d2dc5fd7-82e3-4366-9b58-94ece49ffb47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:27.958840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d2dc5fd7-82e3-4366-9b58-94ece49ffb47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:27.958840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d2dc5fd7-82e3-4366-9b58-94ece49ffb47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:27.958840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d2dc5fd7-82e3-4366-9b58-94ece49ffb47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.958840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d2dc5fd7-82e3-4366-9b58-94ece49ffb47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:27.959285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d2dc5fd7-82e3-4366-9b58-94ece49ffb47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.064433 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d2dc5fd7-82e3-4366-9b58-94ece49ffb47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:28.073017 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d2dc5fd7-82e3-4366-9b58-94ece49ffb47 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.192225 Jul 28 04:01:28.073706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 191/400] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:27 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:28.303326 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-15bb2aae-cb47-459b-986e-d6198458ef0b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:28.304766 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-15bb2aae-cb47-459b-986e-d6198458ef0b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:28.341166 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-15bb2aae-cb47-459b-986e-d6198458ef0b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.343790 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8a3da085-2654-469a-927e-ed487496ab6a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:28.344381 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8a3da085-2654-469a-927e-ed487496ab6a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:28.344896 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-15bb2aae-cb47-459b-986e-d6198458ef0b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.349367 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-15bb2aae-cb47-459b-986e-d6198458ef0b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.351032 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-15bb2aae-cb47-459b-986e-d6198458ef0b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.356757 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a3da085-2654-469a-927e-ed487496ab6a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.360333 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a3da085-2654-469a-927e-ed487496ab6a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.361399 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a3da085-2654-469a-927e-ed487496ab6a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.368430 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a3da085-2654-469a-927e-ed487496ab6a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.656371 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8a3da085-2654-469a-927e-ed487496ab6a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:28.667227 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8a3da085-2654-469a-927e-ed487496ab6a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.328393 Jul 28 04:01:28.673318 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 192/401] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:28 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:28.688575 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-aaca1e8d-03f9-4afb-a077-2cc8f139cbce tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:28.689704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-aaca1e8d-03f9-4afb-a077-2cc8f139cbce tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:28.696143 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-15bb2aae-cb47-459b-986e-d6198458ef0b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:28.707349 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-15bb2aae-cb47-459b-986e-d6198458ef0b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1710 microversion: 2.1 time: 0.405024 Jul 28 04:01:28.708409 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 210/402] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:28 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1710 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:28.723006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aaca1e8d-03f9-4afb-a077-2cc8f139cbce tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.723006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aaca1e8d-03f9-4afb-a077-2cc8f139cbce tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.723006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aaca1e8d-03f9-4afb-a077-2cc8f139cbce tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.727106 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:28.727732 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:28.728749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-aaca1e8d-03f9-4afb-a077-2cc8f139cbce tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.744466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.744856 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.757335 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.757335 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.006876 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:29.017098 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:29.019089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:29.020738 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d1f5b9c6-ce0c-49d9-9a13-275eec5db903 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.301176 Jul 28 04:01:29.027105 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 211/403] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:28 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:29.027368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-aaca1e8d-03f9-4afb-a077-2cc8f139cbce tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:29.029826 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-94ece421-17cb-4b44-8ab4-4510b267cdd9 req-370c5c40-c961-4cb3-b8a1-46f9446b0183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be29dfe-7a22-4f92-bcc4-5949f0565cce", "tag": "7b825057-8fcf-4f6a-a139-762e2220c27f"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:29.033617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-aaca1e8d-03f9-4afb-a077-2cc8f139cbce tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1496 microversion: 2.1 time: 0.360262 Jul 28 04:01:29.043987 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 193/404] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:28 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1496 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:29.044213 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-94ece421-17cb-4b44-8ab4-4510b267cdd9 req-370c5c40-c961-4cb3-b8a1-46f9446b0183 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.044213 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-94ece421-17cb-4b44-8ab4-4510b267cdd9 req-370c5c40-c961-4cb3-b8a1-46f9446b0183 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.071090 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-94ece421-17cb-4b44-8ab4-4510b267cdd9 req-370c5c40-c961-4cb3-b8a1-46f9446b0183 service nova] Creating event network-changed:7b825057-8fcf-4f6a-a139-762e2220c27f for instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce on hv-cinder-85127 Jul 28 04:01:29.086932 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-94ece421-17cb-4b44-8ab4-4510b267cdd9 req-370c5c40-c961-4cb3-b8a1-46f9446b0183 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062278 Jul 28 04:01:29.093086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 212/405] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:29.101591 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d0b18fc2-073c-44b3-a080-8eaeebe8000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:29.101591 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d0b18fc2-073c-44b3-a080-8eaeebe8000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:29.106471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0b18fc2-073c-44b3-a080-8eaeebe8000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.106972 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0b18fc2-073c-44b3-a080-8eaeebe8000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.109026 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0b18fc2-073c-44b3-a080-8eaeebe8000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.109704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0b18fc2-073c-44b3-a080-8eaeebe8000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.112798 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=100 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:29.449607 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d0b18fc2-073c-44b3-a080-8eaeebe8000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:29.478583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d0b18fc2-073c-44b3-a080-8eaeebe8000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.386309 Jul 28 04:01:29.492606 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 194/406] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:29 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:29.708818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bc3b71ad-75ae-4993-8f5d-cbbd4dbd7da2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:29.709748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-bc3b71ad-75ae-4993-8f5d-cbbd4dbd7da2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:29.717402 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bc3b71ad-75ae-4993-8f5d-cbbd4dbd7da2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.718118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bc3b71ad-75ae-4993-8f5d-cbbd4dbd7da2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.725211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bc3b71ad-75ae-4993-8f5d-cbbd4dbd7da2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.731650 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1cc9bb9a-6e66-400b-bd1a-cf82d6234483 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:29.732749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1cc9bb9a-6e66-400b-bd1a-cf82d6234483 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:29.738356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bc3b71ad-75ae-4993-8f5d-cbbd4dbd7da2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.741976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1cc9bb9a-6e66-400b-bd1a-cf82d6234483 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.745256 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1cc9bb9a-6e66-400b-bd1a-cf82d6234483 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.746330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1cc9bb9a-6e66-400b-bd1a-cf82d6234483 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.746959 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1cc9bb9a-6e66-400b-bd1a-cf82d6234483 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.956441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-bc3b71ad-75ae-4993-8f5d-cbbd4dbd7da2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:29.966506 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-bc3b71ad-75ae-4993-8f5d-cbbd4dbd7da2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.263522 Jul 28 04:01:29.967391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 213/407] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:29 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:30.050199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1cc9bb9a-6e66-400b-bd1a-cf82d6234483 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:30.058386 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:30.060649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:30.063282 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1cc9bb9a-6e66-400b-bd1a-cf82d6234483 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1714 microversion: 2.1 time: 0.336048 Jul 28 04:01:30.064206 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 195/408] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:29 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1714 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:30.080263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.080263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.080263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.080263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.252778 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-57c9a705-659e-4547-b450-c56cc273a3b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:30.253407 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-57c9a705-659e-4547-b450-c56cc273a3b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:30.262183 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-57c9a705-659e-4547-b450-c56cc273a3b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.263213 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-57c9a705-659e-4547-b450-c56cc273a3b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.264144 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-57c9a705-659e-4547-b450-c56cc273a3b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.264850 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-57c9a705-659e-4547-b450-c56cc273a3b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.276066 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:30.299707 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:30.302441 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-57c9a705-659e-4547-b450-c56cc273a3b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:01:30.303488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:30.305080 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4a8f26c1-d0e7-40b7-ad1b-f0a630da0bd4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.254095 Jul 28 04:01:30.305668 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 214/409] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:30 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:01:30.506933 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-85535448-77ec-4886-89e9-94bbc385dcaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:30.507817 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-85535448-77ec-4886-89e9-94bbc385dcaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:30.516676 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-85535448-77ec-4886-89e9-94bbc385dcaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.517431 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-85535448-77ec-4886-89e9-94bbc385dcaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.518321 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-85535448-77ec-4886-89e9-94bbc385dcaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.518768 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-85535448-77ec-4886-89e9-94bbc385dcaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.544340 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=16 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:30.594633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:30.691240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-57c9a705-659e-4547-b450-c56cc273a3b1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "DELETE /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 204 len: 0 microversion: 2.1 time: 0.441654 Jul 28 04:01:30.693805 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 196/410] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:01:30 2022] DELETE /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:01:30.703047 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6f5be432-504c-464d-99ca-865ae993a8e1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:30.704042 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6f5be432-504c-464d-99ca-865ae993a8e1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:30.718335 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6f5be432-504c-464d-99ca-865ae993a8e1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.718912 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6f5be432-504c-464d-99ca-865ae993a8e1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.721717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6f5be432-504c-464d-99ca-865ae993a8e1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.722364 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6f5be432-504c-464d-99ca-865ae993a8e1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.783843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-85535448-77ec-4886-89e9-94bbc385dcaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:30.793155 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-85535448-77ec-4886-89e9-94bbc385dcaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1372 microversion: 2.1 time: 0.290976 Jul 28 04:01:30.794407 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 215/411] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:30 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:30.928274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6f5be432-504c-464d-99ca-865ae993a8e1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:30.937820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6f5be432-504c-464d-99ca-865ae993a8e1 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1502 microversion: 2.1 time: 0.239187 Jul 28 04:01:30.951994 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 197/412] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:30 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:30.990962 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-75419c26-3009-43a3-93ee-f09c3ba2e759 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:30.990962 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-75419c26-3009-43a3-93ee-f09c3ba2e759 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:30.992465 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=16 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:31.001229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-75419c26-3009-43a3-93ee-f09c3ba2e759 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.001969 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-75419c26-3009-43a3-93ee-f09c3ba2e759 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:31.002945 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-75419c26-3009-43a3-93ee-f09c3ba2e759 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.003586 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-75419c26-3009-43a3-93ee-f09c3ba2e759 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:31.202642 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-75419c26-3009-43a3-93ee-f09c3ba2e759 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:31.212534 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-75419c26-3009-43a3-93ee-f09c3ba2e759 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.226241 Jul 28 04:01:31.224034 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 216/413] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:30 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:31.331843 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:31.332652 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:31.341380 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.341935 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:31.342846 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.343504 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:31.517214 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:31.535201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:31.536763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:31.538074 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5c2d3281-5d4c-4188-b5f9-1e77b5da92a1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.210537 Jul 28 04:01:31.538649 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 198/414] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:31 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:31.817061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e891bd27-d2a0-46de-822f-aa64bf1da6a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:31.818171 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e891bd27-d2a0-46de-822f-aa64bf1da6a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:31.825186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e891bd27-d2a0-46de-822f-aa64bf1da6a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.825670 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e891bd27-d2a0-46de-822f-aa64bf1da6a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:31.826548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e891bd27-d2a0-46de-822f-aa64bf1da6a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.826993 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e891bd27-d2a0-46de-822f-aa64bf1da6a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.040359 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-07b7688a-e153-49a1-9917-ebb6e96ec9c6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:32.040359 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-07b7688a-e153-49a1-9917-ebb6e96ec9c6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:32.040359 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-07b7688a-e153-49a1-9917-ebb6e96ec9c6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.040359 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-07b7688a-e153-49a1-9917-ebb6e96ec9c6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.040709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-e891bd27-d2a0-46de-822f-aa64bf1da6a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:32.040934 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-07b7688a-e153-49a1-9917-ebb6e96ec9c6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.040934 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-07b7688a-e153-49a1-9917-ebb6e96ec9c6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.041087 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e891bd27-d2a0-46de-822f-aa64bf1da6a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1567 microversion: 2.1 time: 0.164491 Jul 28 04:01:32.041087 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 217/415] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:31 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:32.051452 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b17dc7be-0948-4cee-805b-2ced3a097753 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:32.052005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b17dc7be-0948-4cee-805b-2ced3a097753 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:32.061659 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b17dc7be-0948-4cee-805b-2ced3a097753 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.062154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b17dc7be-0948-4cee-805b-2ced3a097753 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.062939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b17dc7be-0948-4cee-805b-2ced3a097753 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.063674 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b17dc7be-0948-4cee-805b-2ced3a097753 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.144323 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-07b7688a-e153-49a1-9917-ebb6e96ec9c6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:32.155057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-07b7688a-e153-49a1-9917-ebb6e96ec9c6 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1502 microversion: 2.1 time: 0.198087 Jul 28 04:01:32.155737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 199/416] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:31 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:32.175241 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b17dc7be-0948-4cee-805b-2ced3a097753 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127607 Jul 28 04:01:32.175932 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 218/417] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Jul 28 04:01:32 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:32.235522 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f892f080-8ec8-4ef6-9424-757e43065082 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:32.236185 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f892f080-8ec8-4ef6-9424-757e43065082 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:32.242309 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f892f080-8ec8-4ef6-9424-757e43065082 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.242768 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f892f080-8ec8-4ef6-9424-757e43065082 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.243540 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f892f080-8ec8-4ef6-9424-757e43065082 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.244835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f892f080-8ec8-4ef6-9424-757e43065082 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.523296 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f892f080-8ec8-4ef6-9424-757e43065082 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:32.536661 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f892f080-8ec8-4ef6-9424-757e43065082 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.304454 Jul 28 04:01:32.551751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 200/418] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:32 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:32.563601 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:32.564322 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:32.573590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.574101 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.574979 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.575437 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.872916 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:32.889516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:32.894657 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:32.895898 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5875f88c-cbff-4aec-999d-0d9498e0c547 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.336519 Jul 28 04:01:32.913070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 219/419] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:32 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:33.183887 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4c602b9c-7d46-44f4-a496-f99afad3c418 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:33.185012 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4c602b9c-7d46-44f4-a496-f99afad3c418 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:33.194279 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4c602b9c-7d46-44f4-a496-f99afad3c418 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:33.194937 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4c602b9c-7d46-44f4-a496-f99afad3c418 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:33.195943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4c602b9c-7d46-44f4-a496-f99afad3c418 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:33.196609 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4c602b9c-7d46-44f4-a496-f99afad3c418 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:33.562505 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-51388917-2bde-4919-b0d3-f800ce7fc9a8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:33.564213 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-51388917-2bde-4919-b0d3-f800ce7fc9a8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:33.573316 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51388917-2bde-4919-b0d3-f800ce7fc9a8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:33.578531 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51388917-2bde-4919-b0d3-f800ce7fc9a8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:33.578531 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51388917-2bde-4919-b0d3-f800ce7fc9a8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:33.578531 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51388917-2bde-4919-b0d3-f800ce7fc9a8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:33.787000 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4c602b9c-7d46-44f4-a496-f99afad3c418 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:33.805257 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4c602b9c-7d46-44f4-a496-f99afad3c418 tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1502 microversion: 2.1 time: 0.627869 Jul 28 04:01:33.805518 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-51388917-2bde-4919-b0d3-f800ce7fc9a8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:33.809769 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 201/420] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:33 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1502 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:33.835570 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-51388917-2bde-4919-b0d3-f800ce7fc9a8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.280306 Jul 28 04:01:33.849465 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 220/421] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:33 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:33.920399 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:33.921320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:33.928743 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:33.929446 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:33.930458 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:33.931087 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.191984 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:34.207063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:34.209737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:34.211496 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f2c64a72-4fe3-4c87-b6c6-4889900ee73a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.296100 Jul 28 04:01:34.235244 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 202/422] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:33 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:34.653278 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-d7e8d93f-efdd-4f7b-a3a0-6d35d2699db4 req-0f2016dd-a5c3-4444-bdc4-cfd9b83a2a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77990c1b-5f6b-4da2-9963-9507f1e0f714", "name": "network-vif-deleted", "tag": "2f24ff08-75ca-4140-bda6-14f798181200"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:34.664715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-d7e8d93f-efdd-4f7b-a3a0-6d35d2699db4 req-0f2016dd-a5c3-4444-bdc4-cfd9b83a2a04 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:34.665168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-d7e8d93f-efdd-4f7b-a3a0-6d35d2699db4 req-0f2016dd-a5c3-4444-bdc4-cfd9b83a2a04 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.677590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-d7e8d93f-efdd-4f7b-a3a0-6d35d2699db4 req-0f2016dd-a5c3-4444-bdc4-cfd9b83a2a04 service nova] Creating event network-vif-deleted:2f24ff08-75ca-4140-bda6-14f798181200 for instance 77990c1b-5f6b-4da2-9963-9507f1e0f714 on hv-cinder-85127 Jul 28 04:01:34.690920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-d7e8d93f-efdd-4f7b-a3a0-6d35d2699db4 req-0f2016dd-a5c3-4444-bdc4-cfd9b83a2a04 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041506 Jul 28 04:01:34.691838 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 221/423] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:34.834853 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1fa74ba5-280b-437d-8eaf-3776447e877a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:34.838547 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1fa74ba5-280b-437d-8eaf-3776447e877a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:34.846083 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:34.850164 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1fa74ba5-280b-437d-8eaf-3776447e877a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:34.850947 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1fa74ba5-280b-437d-8eaf-3776447e877a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.852631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1fa74ba5-280b-437d-8eaf-3776447e877a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:34.854304 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1fa74ba5-280b-437d-8eaf-3776447e877a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.863422 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0533aeb7-52c5-4b8b-a66e-79d38818f414 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:34.864346 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0533aeb7-52c5-4b8b-a66e-79d38818f414 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:34.882263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0533aeb7-52c5-4b8b-a66e-79d38818f414 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:34.884559 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0533aeb7-52c5-4b8b-a66e-79d38818f414 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.885646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0533aeb7-52c5-4b8b-a66e-79d38818f414 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:34.886104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0533aeb7-52c5-4b8b-a66e-79d38818f414 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.967093 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1fa74ba5-280b-437d-8eaf-3776447e877a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:34.979386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1fa74ba5-280b-437d-8eaf-3776447e877a tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1460 microversion: 2.1 time: 0.148518 Jul 28 04:01:34.992718 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 203/424] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:34 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1460 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:35.185455 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0533aeb7-52c5-4b8b-a66e-79d38818f414 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:35.195484 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0533aeb7-52c5-4b8b-a66e-79d38818f414 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.336570 Jul 28 04:01:35.203733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 222/425] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:34 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:35.244708 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:35.244708 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:35.261686 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:35.264464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:35.266865 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:35.267767 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:35.581000 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:35.589023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:35.593118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:35.595870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-32fd8c76-6f30-48f7-894b-dd5213781937 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.357065 Jul 28 04:01:35.596698 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 204/426] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:35 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:36.007019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:36.007664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:36.016689 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.017266 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.018310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.018997 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.054228 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.054685 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.055151 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lazy-loading 'fault' on Instance uuid 77990c1b-5f6b-4da2-9963-9507f1e0f714 {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:01:36.098343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc5a6050226a4e03b027bc8006e90df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041d959d23d41c58ac1f68559a14647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:36.106716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fad37f7a-3ed0-487e-847f-db3cc0709eff tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 200 len: 1304 microversion: 2.1 time: 0.104434 Jul 28 04:01:36.107620 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 223/427] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:36 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:36.221767 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1fc1d5b9-cdb4-453c-9f4a-db1344e8a3a2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:36.222485 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1fc1d5b9-cdb4-453c-9f4a-db1344e8a3a2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:36.229451 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1fc1d5b9-cdb4-453c-9f4a-db1344e8a3a2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.230139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1fc1d5b9-cdb4-453c-9f4a-db1344e8a3a2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.231080 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1fc1d5b9-cdb4-453c-9f4a-db1344e8a3a2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.231730 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1fc1d5b9-cdb4-453c-9f4a-db1344e8a3a2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.380323 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1fc1d5b9-cdb4-453c-9f4a-db1344e8a3a2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:36.388386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1fc1d5b9-cdb4-453c-9f4a-db1344e8a3a2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.173925 Jul 28 04:01:36.388956 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 205/428] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:36 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:36.619774 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:36.620880 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:36.627810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.628287 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.629249 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.629700 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.719322 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-032e82e4-da7b-4fa4-9bb0-a4cc0de6454a req-fadfc69c-8da5-4b99-862f-f875fd40654d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b", "tag": "d2c58462-fb66-479c-9106-a98477b390b4"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:36.749141 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-032e82e4-da7b-4fa4-9bb0-a4cc0de6454a req-fadfc69c-8da5-4b99-862f-f875fd40654d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.749368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-032e82e4-da7b-4fa4-9bb0-a4cc0de6454a req-fadfc69c-8da5-4b99-862f-f875fd40654d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.765778 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-032e82e4-da7b-4fa4-9bb0-a4cc0de6454a req-fadfc69c-8da5-4b99-862f-f875fd40654d service nova] Creating event network-changed:d2c58462-fb66-479c-9106-a98477b390b4 for instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b on hv-cinder-85127 Jul 28 04:01:36.777998 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-032e82e4-da7b-4fa4-9bb0-a4cc0de6454a req-fadfc69c-8da5-4b99-862f-f875fd40654d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063745 Jul 28 04:01:36.779763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 206/429] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:36.878037 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:36.888745 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:36.890689 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:36.891848 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-071f1c42-cef5-475c-a6b3-f4c0033bcd79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.276725 Jul 28 04:01:36.899113 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 224/430] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:36 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:37.129498 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:37.130197 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] [instance: 77990c1b-5f6b-4da2-9963-9507f1e0f714] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:37.141527 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.146538 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.147916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.148491 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.192193 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] HTTP exception thrown: Instance 77990c1b-5f6b-4da2-9963-9507f1e0f714 could not be found. Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Request method failure captured: Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 HTTP/1.1 Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gnm7KBSmH_WFcgECLHkBVM-LoKwzfMmPAtDc-XwAwhFwX2jUAKIbZ1ESjkA-5mt8BCHK-dR1wPOZ12UMCHmgJDdViZNE09zvzft0JXd7QyLSiOwTqJIkgiNuUekDJdnaFK5WSJOMgS1AL7zm8UJ3-zXOTi9umuxoQcdlMFS87LzxgA Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 7041d959d23d41c58ac1f68559a14647 Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-VolumesActionsTest-1317926626 Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:01:37.206344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7041d959d23d41c58ac1f68559a14647", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7041d959d23d41c58ac1f68559a14647"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7041d959d23d41c58ac1f68559a14647"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7041d959d23d41c58ac1f68559a14647"}]}] Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-VolumesActionsTest-1317926626 Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 7041d959d23d41c58ac1f68559a14647 Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-VolumesActionsTest-1317926626 Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-VolumesActionsTest-1317926626-project Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: dc5a6050226a4e03b027bc8006e90df6 Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-VolumesActionsTest-1317926626-project Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 77990c1b-5f6b-4da2-9963-9507f1e0f714 could not be found. Jul 28 04:01:37.208415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '77990c1b-5f6b-4da2-9963-9507f1e0f714'} Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77990c1b-5f6b-4da2-9963-9507f1e0f714 could not be found. Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:01:37.209280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77990c1b-5f6b-4da2-9963-9507f1e0f714 could not be found. Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77990c1b-5f6b-4da2-9963-9507f1e0f714 could not be found. Jul 28 04:01:37.210874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:01:37.218167 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] Returning 404 to user: Instance 77990c1b-5f6b-4da2-9963-9507f1e0f714 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:01:37.219241 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ea319c58-7181-434a-a45e-56cbeb03348e tempest-VolumesActionsTest-1317926626 tempest-VolumesActionsTest-1317926626-project] 10.222.0.66 "GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714" status: 404 len: 111 microversion: 2.1 time: 0.094924 Jul 28 04:01:37.223917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 207/431] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:37 2022] GET /compute/v2.1/servers/77990c1b-5f6b-4da2-9963-9507f1e0f714 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:01:37.410433 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f089ad95-a9ad-4aab-b19c-363a74772eb7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:37.411801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f089ad95-a9ad-4aab-b19c-363a74772eb7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:37.429913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f089ad95-a9ad-4aab-b19c-363a74772eb7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.430728 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f089ad95-a9ad-4aab-b19c-363a74772eb7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.432995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f089ad95-a9ad-4aab-b19c-363a74772eb7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.435059 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f089ad95-a9ad-4aab-b19c-363a74772eb7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.795553 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f089ad95-a9ad-4aab-b19c-363a74772eb7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:37.803519 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f089ad95-a9ad-4aab-b19c-363a74772eb7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.396779 Jul 28 04:01:37.820894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 225/432] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:37 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:37.923123 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:37.923658 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:37.930452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.930898 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.932387 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.932966 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:38.125744 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:38.134215 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:38.136889 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:38.138111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-371c517a-3a63-48e1-8a7b-67ecaa3f0f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1740 microversion: 2.20 time: 0.219013 Jul 28 04:01:38.147682 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 208/433] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:37 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:38.833071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2bfc8e3a-fb98-4132-b5db-031751b8243b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:38.833702 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2bfc8e3a-fb98-4132-b5db-031751b8243b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:38.840741 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2bfc8e3a-fb98-4132-b5db-031751b8243b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:38.841198 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2bfc8e3a-fb98-4132-b5db-031751b8243b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:38.841991 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2bfc8e3a-fb98-4132-b5db-031751b8243b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:38.842724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2bfc8e3a-fb98-4132-b5db-031751b8243b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:38.847298 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=100 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:39.002715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2bfc8e3a-fb98-4132-b5db-031751b8243b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:39.008418 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-5c78790d-9c2b-4a03-8734-dbe7c745c8fe req-56f10cb7-01c2-4d79-9586-74490902dd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be29dfe-7a22-4f92-bcc4-5949f0565cce", "name": "network-vif-plugged", "status": "completed", "tag": "7b825057-8fcf-4f6a-a139-762e2220c27f"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:39.011643 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2bfc8e3a-fb98-4132-b5db-031751b8243b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.182547 Jul 28 04:01:39.012442 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 226/434] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:38 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:39.021082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-5c78790d-9c2b-4a03-8734-dbe7c745c8fe req-56f10cb7-01c2-4d79-9586-74490902dd4b service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:39.021622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-5c78790d-9c2b-4a03-8734-dbe7c745c8fe req-56f10cb7-01c2-4d79-9586-74490902dd4b service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:39.033667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-5c78790d-9c2b-4a03-8734-dbe7c745c8fe req-56f10cb7-01c2-4d79-9586-74490902dd4b service nova] Creating event network-vif-plugged:7b825057-8fcf-4f6a-a139-762e2220c27f for instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce on hv-cinder-85127 Jul 28 04:01:39.038595 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-5c78790d-9c2b-4a03-8734-dbe7c745c8fe req-56f10cb7-01c2-4d79-9586-74490902dd4b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034394 Jul 28 04:01:39.039187 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 209/435] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:39.166699 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:39.168218 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:39.179320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:39.180486 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:39.181942 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:39.182733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:39.364976 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:39.376291 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:39.377801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:39.378974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f5b00cb4-bef0-4cc1-8d96-6ade8ebebd0c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1722 microversion: 2.20 time: 0.220577 Jul 28 04:01:39.379548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 227/436] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:39 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:01:40.033451 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-15f3ec09-0b1f-4f73-a1f2-0547ec2f6e88 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:40.034155 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-15f3ec09-0b1f-4f73-a1f2-0547ec2f6e88 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:40.041924 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-15f3ec09-0b1f-4f73-a1f2-0547ec2f6e88 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.042795 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-15f3ec09-0b1f-4f73-a1f2-0547ec2f6e88 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.044324 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-15f3ec09-0b1f-4f73-a1f2-0547ec2f6e88 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.045039 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-15f3ec09-0b1f-4f73-a1f2-0547ec2f6e88 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.219254 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-15f3ec09-0b1f-4f73-a1f2-0547ec2f6e88 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:40.229883 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-15f3ec09-0b1f-4f73-a1f2-0547ec2f6e88 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.201014 Jul 28 04:01:40.230601 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 210/437] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:40 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:40.403537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:40.404304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:40.410942 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.411347 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.412323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.412654 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.553671 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:40.563085 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:40.564646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:40.565828 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-07d7be62-2f79-4172-b6de-cae167f28878 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1722 microversion: 2.20 time: 0.166823 Jul 28 04:01:40.566489 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 228/438] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:40 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:41.255969 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-023852f1-a9a9-4503-bde6-67cd1e63521d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:41.256796 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-023852f1-a9a9-4503-bde6-67cd1e63521d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:41.264490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-023852f1-a9a9-4503-bde6-67cd1e63521d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:41.264944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-023852f1-a9a9-4503-bde6-67cd1e63521d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:41.265825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-023852f1-a9a9-4503-bde6-67cd1e63521d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:41.266275 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-023852f1-a9a9-4503-bde6-67cd1e63521d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:41.269193 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:41.411126 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-023852f1-a9a9-4503-bde6-67cd1e63521d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:41.418357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-023852f1-a9a9-4503-bde6-67cd1e63521d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.166642 Jul 28 04:01:41.418913 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 211/439] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:41 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:41.589809 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:41.591053 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:41.598953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:41.598953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:41.599721 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:41.600190 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:41.736812 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:41.745487 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:41.748607 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:41.748607 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-df7ffd1d-b031-4a01-988b-fe37bc07115c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1722 microversion: 2.20 time: 0.162740 Jul 28 04:01:41.749092 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 229/440] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:41 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:42.440114 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d4b257e1-5aed-4fcc-a7f6-85cee1996483 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:42.440819 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d4b257e1-5aed-4fcc-a7f6-85cee1996483 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:42.448768 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d4b257e1-5aed-4fcc-a7f6-85cee1996483 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:42.449223 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d4b257e1-5aed-4fcc-a7f6-85cee1996483 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:42.450005 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d4b257e1-5aed-4fcc-a7f6-85cee1996483 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:42.450450 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d4b257e1-5aed-4fcc-a7f6-85cee1996483 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:42.584428 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d4b257e1-5aed-4fcc-a7f6-85cee1996483 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:42.592905 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d4b257e1-5aed-4fcc-a7f6-85cee1996483 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.156788 Jul 28 04:01:42.593477 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 212/441] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:42 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:42.772363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:42.772984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:42.780325 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:42.780785 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:42.781565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:42.782012 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:42.913869 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-18449b78-52a2-483e-aaa6-9af4cdacf326 req-0dd0b468-fd98-4bca-b29a-c28209996227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eadfe50-2ab9-46dc-be42-b9496e4008ac", "name": "network-vif-unplugged", "status": "completed", "tag": "ef1e8289-929e-424e-b1c1-98a45ed868ea"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:42.920999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:42.925092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-18449b78-52a2-483e-aaa6-9af4cdacf326 req-0dd0b468-fd98-4bca-b29a-c28209996227 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:42.925551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-18449b78-52a2-483e-aaa6-9af4cdacf326 req-0dd0b468-fd98-4bca-b29a-c28209996227 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:42.929269 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:42.930778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:42.932899 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a60951fd-474e-4da2-bb83-34d7a52ea8f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1722 microversion: 2.20 time: 0.164524 Jul 28 04:01:42.933469 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 230/442] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:42 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:42.938494 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-18449b78-52a2-483e-aaa6-9af4cdacf326 req-0dd0b468-fd98-4bca-b29a-c28209996227 service nova] Creating event network-vif-unplugged:ef1e8289-929e-424e-b1c1-98a45ed868ea for instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac on hv-cinder-85127 Jul 28 04:01:42.943886 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-18449b78-52a2-483e-aaa6-9af4cdacf326 req-0dd0b468-fd98-4bca-b29a-c28209996227 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034906 Jul 28 04:01:42.944462 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 213/443] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:43.615326 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a008a670-cc00-4ae8-8510-2ad1732fd43c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:43.616416 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a008a670-cc00-4ae8-8510-2ad1732fd43c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:43.626178 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a008a670-cc00-4ae8-8510-2ad1732fd43c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:43.626861 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a008a670-cc00-4ae8-8510-2ad1732fd43c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:43.627875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a008a670-cc00-4ae8-8510-2ad1732fd43c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:43.628348 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a008a670-cc00-4ae8-8510-2ad1732fd43c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:43.783714 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a008a670-cc00-4ae8-8510-2ad1732fd43c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:43.791929 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a008a670-cc00-4ae8-8510-2ad1732fd43c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.181795 Jul 28 04:01:43.792702 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 231/444] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:43 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:43.958036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:43.958770 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:43.967892 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:43.968712 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:43.969648 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:43.970158 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:44.129442 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:44.139072 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:44.140629 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:44.142033 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ea007d7d-9c7c-4c91-8343-633cc41ef4bd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1722 microversion: 2.20 time: 0.188668 Jul 28 04:01:44.142593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 214/445] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:43 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:44.819663 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2d7a60e3-3314-4bbf-9bcc-e3d0ee73b8d2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:44.822788 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2d7a60e3-3314-4bbf-9bcc-e3d0ee73b8d2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:44.838994 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2d7a60e3-3314-4bbf-9bcc-e3d0ee73b8d2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:44.847880 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2d7a60e3-3314-4bbf-9bcc-e3d0ee73b8d2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:44.853062 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2d7a60e3-3314-4bbf-9bcc-e3d0ee73b8d2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:44.853062 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2d7a60e3-3314-4bbf-9bcc-e3d0ee73b8d2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:45.119354 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2d7a60e3-3314-4bbf-9bcc-e3d0ee73b8d2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:45.135627 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2d7a60e3-3314-4bbf-9bcc-e3d0ee73b8d2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1366 microversion: 2.1 time: 0.322956 Jul 28 04:01:45.136744 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 232/446] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:44 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:45.168865 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:45.169674 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:45.181633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:45.181633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:45.183604 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:45.184159 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:45.347325 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:45.362995 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:45.366579 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:45.368175 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-bd78df86-dfff-493d-8b15-bebb3fc36ff5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1725 microversion: 2.20 time: 0.204217 Jul 28 04:01:45.371845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 215/447] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:45 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:45.406686 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-104dd5e0-b556-4bd2-aaee-3d2a9056c61e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be47d93a-6d2d-4343-805a-0e81adf44856"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:45.409701 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-104dd5e0-b556-4bd2-aaee-3d2a9056c61e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:45.418091 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-104dd5e0-b556-4bd2-aaee-3d2a9056c61e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:45.418698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-104dd5e0-b556-4bd2-aaee-3d2a9056c61e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:45.419651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-104dd5e0-b556-4bd2-aaee-3d2a9056c61e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:45.420361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-104dd5e0-b556-4bd2-aaee-3d2a9056c61e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.158634 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-fe38873e-b475-4731-843a-fa2d61573ed2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:46.159258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-fe38873e-b475-4731-843a-fa2d61573ed2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:46.220255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fe38873e-b475-4731-843a-fa2d61573ed2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.221182 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fe38873e-b475-4731-843a-fa2d61573ed2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.222204 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fe38873e-b475-4731-843a-fa2d61573ed2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.222813 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fe38873e-b475-4731-843a-fa2d61573ed2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.414056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-fe38873e-b475-4731-843a-fa2d61573ed2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:46.424630 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-fe38873e-b475-4731-843a-fa2d61573ed2 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1557 microversion: 2.1 time: 0.269976 Jul 28 04:01:46.427554 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 216/448] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:46 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1557 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:46.452453 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7931f151-3f0d-43f5-8e0e-a25faa18a13a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:46.452641 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7931f151-3f0d-43f5-8e0e-a25faa18a13a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:46.461424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7931f151-3f0d-43f5-8e0e-a25faa18a13a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.461892 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7931f151-3f0d-43f5-8e0e-a25faa18a13a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.463284 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7931f151-3f0d-43f5-8e0e-a25faa18a13a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.463808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7931f151-3f0d-43f5-8e0e-a25faa18a13a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.559237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7931f151-3f0d-43f5-8e0e-a25faa18a13a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111210 Jul 28 04:01:46.559858 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 217/449] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Jul 28 04:01:46 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:46.620212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-104dd5e0-b556-4bd2-aaee-3d2a9056c61e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.223151 Jul 28 04:01:46.621672 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 233/450] 10.222.0.66 () {62 vars in 1364 bytes} [Thu Jul 28 04:01:45 2022] POST /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments => generated 188 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:01:46.845636 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0a8c0f8f-b383-40fa-8822-1f3eb717a249 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:46.846591 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0a8c0f8f-b383-40fa-8822-1f3eb717a249 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:46.854075 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0a8c0f8f-b383-40fa-8822-1f3eb717a249 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.854832 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0a8c0f8f-b383-40fa-8822-1f3eb717a249 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.855807 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0a8c0f8f-b383-40fa-8822-1f3eb717a249 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.857232 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0a8c0f8f-b383-40fa-8822-1f3eb717a249 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.913599 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0a8c0f8f-b383-40fa-8822-1f3eb717a249 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=135704) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 04:01:47.519577 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0a8c0f8f-b383-40fa-8822-1f3eb717a249 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/action" status: 202 len: 0 microversion: 2.20 time: 0.678520 Jul 28 04:01:47.520859 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 218/451] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Jul 28 04:01:46 2022] POST /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/action => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:01:47.533725 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:47.540640 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:47.562160 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:47.563285 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:47.565052 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:47.566123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.070136 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:48.082661 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:48.084535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:48.086151 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6f41b892-edb9-44a5-aec7-1163c48ba668 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.560054 Jul 28 04:01:48.087163 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 234/452] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:47 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:48.496219 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-c8fec7bb-5e41-46b1-8c74-24016c9bdf61 req-9505c377-546e-4625-a1ae-1813d0c414e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be29dfe-7a22-4f92-bcc4-5949f0565cce", "tag": "7b825057-8fcf-4f6a-a139-762e2220c27f"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:48.508875 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-c8fec7bb-5e41-46b1-8c74-24016c9bdf61 req-9505c377-546e-4625-a1ae-1813d0c414e5 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:48.509481 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-c8fec7bb-5e41-46b1-8c74-24016c9bdf61 req-9505c377-546e-4625-a1ae-1813d0c414e5 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.521893 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-c8fec7bb-5e41-46b1-8c74-24016c9bdf61 req-9505c377-546e-4625-a1ae-1813d0c414e5 service nova] Creating event network-changed:7b825057-8fcf-4f6a-a139-762e2220c27f for instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce on hv-cinder-85127 Jul 28 04:01:48.528623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-c8fec7bb-5e41-46b1-8c74-24016c9bdf61 req-9505c377-546e-4625-a1ae-1813d0c414e5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036582 Jul 28 04:01:48.531868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 219/453] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:49.117101 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:49.118084 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:49.129919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.142635 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.148098 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.148098 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.449956 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:49.461967 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:49.464722 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:49.466239 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7f902c27-c66b-4737-b00d-1e0e69069b61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.358493 Jul 28 04:01:49.467386 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 235/454] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:49 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:01:50.508095 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:50.508863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:50.518050 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:50.518507 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:50.519489 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:50.519942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:50.691437 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:50.705115 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:50.707393 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:50.709218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d7f50729-1c39-4f2a-90b8-f6a2337cf3ac tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.205447 Jul 28 04:01:50.710399 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 220/455] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:50 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:51.736205 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:51.737067 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:51.739829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=96 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:51.746052 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:51.746701 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:51.747633 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:51.748174 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:51.945789 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:51.955666 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:51.957521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:51.958892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3db63315-bce4-48c8-9553-c3b0d7aa8c51 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.227044 Jul 28 04:01:51.959451 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 236/456] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:51 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:52.984028 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:52.984773 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:52.991664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:52.992243 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:52.993289 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:52.994364 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.149150 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:53.164911 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:53.167624 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:53.169690 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f380a578-555f-4915-8eaa-9e3e3c35df0a tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.189783 Jul 28 04:01:53.170520 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 221/457] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:52 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:54.206694 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:54.207509 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:54.215430 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:54.215910 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:54.216716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:54.217159 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:54.383563 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:54.392646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:54.394168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:54.395424 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-87f56856-2387-48a6-a0ee-170c71e8cd97 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.192607 Jul 28 04:01:54.396041 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 237/458] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:54 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:55.424269 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:55.424878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:55.434622 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:55.435411 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:55.436425 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:55.436872 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:55.603994 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:55.618436 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:55.622506 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:55.624991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-566b522a-010d-4db1-9402-62078d402466 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.205649 Jul 28 04:01:55.626036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 222/459] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:55 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:56.655188 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:56.655825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:56.662421 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:56.662869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:56.663639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:56.664125 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:56.833646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:56.844673 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:56.846545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:56.848036 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-360662ce-5fae-4d2c-888b-b065508119d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.196829 Jul 28 04:01:56.849342 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 238/460] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:56 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:57.876239 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:57.877155 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:57.896502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:57.897211 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:57.898007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:57.898456 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:58.068830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:58.080072 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:58.081957 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:58.083071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4ca79698-44ec-4f78-8089-aa4700c310f7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.212140 Jul 28 04:01:58.083632 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 223/461] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:57 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:59.121918 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:59.122589 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:59.130148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:59.130633 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:59.131734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:59.132303 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:59.288514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:59.297970 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:59.299565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:59.300775 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c2b5c56b-7011-41b6-80b5-309991427d81 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.183800 Jul 28 04:01:59.301346 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 239/462] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:59 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:00.325609 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:00.326883 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:00.341358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:00.345079 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:00.349468 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:00.349468 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:00.503688 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:00.512998 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:00.514495 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:00.515750 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-cf58ca63-c188-4c4b-bd4a-aa5e9a71b612 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1751 microversion: 2.20 time: 0.195396 Jul 28 04:02:00.516274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 224/463] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:00 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:01.541332 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:01.542166 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:01.550452 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:01.550909 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:01.551709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:01.552195 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:01.557786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:01.725051 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:01.734774 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:01.737778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:01.739568 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-703d1d98-8253-4f3e-b0e7-c0078afe8dc6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1753 microversion: 2.20 time: 0.203655 Jul 28 04:02:01.740561 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 240/464] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:01 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:02.764471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:02.766740 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:02.778758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:02.779210 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:02.780032 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:02.780474 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:03.031683 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:03.064319 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:03.070248 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:03.073682 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-108ac966-6fb5-42b4-8be5-75f098b63f6f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.312836 Jul 28 04:02:03.075867 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 225/465] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:02 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:04.123844 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:04.125238 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:04.133210 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:04.133847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:04.135518 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:04.136224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:04.295842 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:04.307485 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:04.309387 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:04.310833 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ca704655-46b1-4680-9469-54ea243cb4f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.192740 Jul 28 04:02:04.311553 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 241/466] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:04 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:05.336976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:05.338408 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:05.348356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:05.362161 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:05.362989 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:05.364086 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:05.364756 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:05.593331 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:05.611033 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:05.615264 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:05.617877 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-12be7016-c3b9-4ac0-918c-fdb906b040fb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.285318 Jul 28 04:02:05.641377 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 226/467] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:05 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:06.723109 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:06.723109 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:06.723109 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:06.723109 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:06.724348 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:06.724348 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:06.929425 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:06.950924 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:06.953916 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:06.956571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ac3f2532-058c-4db2-9625-dae6d6f0a172 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.306913 Jul 28 04:02:06.957361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 242/468] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:06 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:07.996855 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:07.997938 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:08.005315 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:08.005794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:08.006641 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:08.007132 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:08.300825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:08.300825 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:08.301270 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:08.301270 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ad0c2f2b-5a53-40c6-b2fa-f60a0eba4598 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.266891 Jul 28 04:02:08.301270 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 227/469] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:07 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:09.284251 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:09.284866 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:09.293070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:09.293522 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:09.294327 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:09.294769 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:09.466417 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:09.475921 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:09.477461 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:09.479408 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-11c4e581-fb98-4b3c-81a0-895bda07e3d1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.199191 Jul 28 04:02:09.480047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 243/470] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:09 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:10.508460 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:10.515722 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:10.530143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:10.530861 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:10.532396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:10.533242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:10.591524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:10.975676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:10.975676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:10.975933 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:10.975933 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7dee7fec-4c93-448c-b406-e0b276baa851 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.367307 Jul 28 04:02:10.975933 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 228/471] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:10 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:11.980925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:11.982409 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:11.989713 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.990900 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.992197 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.992926 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:12.235977 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:12.253744 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:12.256857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:12.259156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6c9beba3-e36a-46b1-a9d2-1b27f7e63738 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.283467 Jul 28 04:02:12.260482 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 244/472] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:11 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:13.287123 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:13.288409 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:13.302099 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:13.302763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:13.303672 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:13.304258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:13.537530 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:13.551676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:13.553382 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:13.554788 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ea35fb0d-191e-48f3-8f86-0d5f8eef318d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.273624 Jul 28 04:02:13.555902 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 229/473] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:13 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:14.580641 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:14.581293 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:14.589100 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:14.589562 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:14.590506 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:14.590815 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:14.795365 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:14.812501 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:14.814450 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:14.815876 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e04edd80-96b8-4784-88e8-fc881702d28c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.239662 Jul 28 04:02:14.816637 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 245/474] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:14 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:15.841440 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:15.841440 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:15.847764 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:15.848263 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:15.852983 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:15.852983 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:16.032595 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:16.042807 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:16.044487 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:16.045706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8941fba6-99f5-48ca-8887-d76594698212 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.210087 Jul 28 04:02:16.046658 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 230/475] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:15 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:17.070938 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:17.072158 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:17.079177 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:17.079643 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:17.080482 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:17.080929 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:17.251552 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:17.264254 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:17.266320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:17.267811 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fe91161c-1056-45d2-8b07-05af7aa4e759 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.201054 Jul 28 04:02:17.269286 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 246/476] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:17 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:18.292465 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:18.293097 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:18.300470 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:18.300929 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:18.301715 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:18.302159 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:18.491389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:18.501662 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:18.503096 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:18.504375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-02d5d427-2ee5-4bb6-9965-e3c862a803c1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.216601 Jul 28 04:02:18.504937 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 231/477] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:18 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:19.534584 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:19.536550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:19.547771 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:19.548555 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:19.549934 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:19.550660 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:19.737848 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:19.751700 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:19.754773 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:19.757649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-96f933e8-e401-4fc3-b70c-f63887f948c9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.229432 Jul 28 04:02:19.757972 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 247/478] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:19 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:20.799306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:20.800151 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:20.808925 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:20.809479 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:20.810355 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:20.810940 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:21.006900 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:21.021747 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:21.026367 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:21.029203 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-691e2f49-f2da-4dd8-be3a-f037f3e1da03 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.234228 Jul 28 04:02:21.030593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 232/479] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:20 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:22.062808 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:22.065163 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:22.069641 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=24 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:22.083435 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:22.084308 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:22.085958 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:22.087352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:22.269908 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:22.282584 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:22.286915 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:22.286915 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-00e9f5d7-5fb3-4898-ad27-c3e5b5a8c1f4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.232263 Jul 28 04:02:22.286915 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 248/480] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:22 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:22.861420 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f7b64877-f8ca-4532-b2ce-e9baa53e062c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:22.862319 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f7b64877-f8ca-4532-b2ce-e9baa53e062c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:22.870572 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f7b64877-f8ca-4532-b2ce-e9baa53e062c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:22.871473 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f7b64877-f8ca-4532-b2ce-e9baa53e062c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:22.872701 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f7b64877-f8ca-4532-b2ce-e9baa53e062c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:22.873155 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f7b64877-f8ca-4532-b2ce-e9baa53e062c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:23.062998 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-f7b64877-f8ca-4532-b2ce-e9baa53e062c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lazy-loading 'services' on Instance uuid 69722c89-ea87-415c-8a3c-b10f0bff6b9e {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:02:23.311032 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:23.311647 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:23.318834 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:23.319288 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:23.320133 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:23.320597 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:23.376457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f7b64877-f8ca-4532-b2ce-e9baa53e062c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "DELETE /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/os-volume_attachments/07913462-fc39-44ed-8f6d-c4796a432498" status: 202 len: 0 microversion: 2.1 time: 0.518339 Jul 28 04:02:23.377093 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 233/481] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:02:22 2022] DELETE /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/os-volume_attachments/07913462-fc39-44ed-8f6d-c4796a432498 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:02:23.492709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:23.504704 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:23.506087 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:23.507353 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c9e09f60-9f3e-43fc-aed0-5302dd15a813 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.200958 Jul 28 04:02:23.507918 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 249/482] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:23 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:24.536148 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:24.537034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:24.545456 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:24.545908 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:24.546718 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:24.547157 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:24.711251 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-de390cc7-bded-4ab5-b17d-e90a07a56487 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:24.718572 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-de390cc7-bded-4ab5-b17d-e90a07a56487 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:24.719041 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-de390cc7-bded-4ab5-b17d-e90a07a56487 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:24.745632 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-de390cc7-bded-4ab5-b17d-e90a07a56487 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Going to try to stop instance {{(pid=135703) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:02:25.028619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-de390cc7-bded-4ab5-b17d-e90a07a56487 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.320889 Jul 28 04:02:25.029290 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 250/483] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:02:24 2022] POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:02:25.039903 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0f944bb5-57c1-4abc-8fc2-72115120893c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:25.041211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0f944bb5-57c1-4abc-8fc2-72115120893c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:25.048980 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0f944bb5-57c1-4abc-8fc2-72115120893c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:25.049515 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0f944bb5-57c1-4abc-8fc2-72115120893c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:25.050370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0f944bb5-57c1-4abc-8fc2-72115120893c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:25.051031 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0f944bb5-57c1-4abc-8fc2-72115120893c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:25.260674 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0f944bb5-57c1-4abc-8fc2-72115120893c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:25.282430 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0f944bb5-57c1-4abc-8fc2-72115120893c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1678 microversion: 2.1 time: 0.246575 Jul 28 04:02:25.284061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 251/484] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:25 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:25.335194 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:25.346154 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:25.347750 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:25.349054 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5cb4ae17-0e17-43b8-99de-d6b3c1e1b342 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.817934 Jul 28 04:02:25.349989 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 234/485] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:24 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:26.309006 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7e46ab28-67d5-4627-91fa-d660e91110ac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:26.311010 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7e46ab28-67d5-4627-91fa-d660e91110ac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:26.319891 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e46ab28-67d5-4627-91fa-d660e91110ac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:26.322940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e46ab28-67d5-4627-91fa-d660e91110ac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:26.322940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e46ab28-67d5-4627-91fa-d660e91110ac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:26.322940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e46ab28-67d5-4627-91fa-d660e91110ac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:26.381411 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:26.388715 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:26.405703 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:26.406640 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:26.407999 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:26.408735 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:26.547077 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7e46ab28-67d5-4627-91fa-d660e91110ac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:26.557882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7e46ab28-67d5-4627-91fa-d660e91110ac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1678 microversion: 2.1 time: 0.254081 Jul 28 04:02:26.558744 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 252/486] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:26 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:26.595474 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:26.610550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:26.617284 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:26.617284 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d7ee2249-dfa5-406d-b528-2185be31b09e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.242006 Jul 28 04:02:26.617284 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 235/487] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:26 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:27.353869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-6fc01467-d99a-4081-be8a-68fed31e8654 req-b01793a4-b9eb-4a28-9b89-bfe94b9eebb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eadfe50-2ab9-46dc-be42-b9496e4008ac", "name": "network-vif-plugged", "status": "completed", "tag": "ef1e8289-929e-424e-b1c1-98a45ed868ea"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:27.366520 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-6fc01467-d99a-4081-be8a-68fed31e8654 req-b01793a4-b9eb-4a28-9b89-bfe94b9eebb2 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.366988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-6fc01467-d99a-4081-be8a-68fed31e8654 req-b01793a4-b9eb-4a28-9b89-bfe94b9eebb2 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.381536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-6fc01467-d99a-4081-be8a-68fed31e8654 req-b01793a4-b9eb-4a28-9b89-bfe94b9eebb2 service nova] Creating event network-vif-plugged:ef1e8289-929e-424e-b1c1-98a45ed868ea for instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac on hv-cinder-85127 Jul 28 04:02:27.387871 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-6fc01467-d99a-4081-be8a-68fed31e8654 req-b01793a4-b9eb-4a28-9b89-bfe94b9eebb2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038204 Jul 28 04:02:27.388754 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 253/488] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:02:27.584950 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-51313f7d-b8a1-47c3-be46-fa741759543b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:27.585951 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-51313f7d-b8a1-47c3-be46-fa741759543b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:27.593689 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-51313f7d-b8a1-47c3-be46-fa741759543b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.594266 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-51313f7d-b8a1-47c3-be46-fa741759543b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.595188 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-51313f7d-b8a1-47c3-be46-fa741759543b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.595774 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-51313f7d-b8a1-47c3-be46-fa741759543b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.657966 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:27.658956 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:27.671308 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.671769 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.672619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.673063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.852317 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-51313f7d-b8a1-47c3-be46-fa741759543b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:27.885459 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-51313f7d-b8a1-47c3-be46-fa741759543b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1678 microversion: 2.1 time: 0.305171 Jul 28 04:02:27.886643 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 236/489] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:27 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1678 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:27.933217 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:27.945554 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:27.949323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:27.952394 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7dd810e0-940f-4a3a-b8ac-63b41021b76b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.299151 Jul 28 04:02:27.953661 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 254/490] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:27 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:28.950006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-de6146b0-93bc-4eb2-978e-38fccf89c361 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:28.950912 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-de6146b0-93bc-4eb2-978e-38fccf89c361 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:28.961646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-de6146b0-93bc-4eb2-978e-38fccf89c361 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:28.963560 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-de6146b0-93bc-4eb2-978e-38fccf89c361 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:28.964232 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-de6146b0-93bc-4eb2-978e-38fccf89c361 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:28.965104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-de6146b0-93bc-4eb2-978e-38fccf89c361 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:28.993029 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:28.996490 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:29.011268 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:29.012674 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:29.014487 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:29.015492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:29.197403 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-de6146b0-93bc-4eb2-978e-38fccf89c361 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:29.218181 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-de6146b0-93bc-4eb2-978e-38fccf89c361 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1678 microversion: 2.1 time: 0.273714 Jul 28 04:02:29.220279 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 237/491] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:28 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:29.277441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:29.288338 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:29.289865 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:29.291468 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3e502629-c099-4907-ae5f-5aeb1793616b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.306472 Jul 28 04:02:29.291774 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 255/492] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:28 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:30.242070 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4722682d-61ea-475d-ad16-c425741d7055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:30.242804 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4722682d-61ea-475d-ad16-c425741d7055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:30.252318 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4722682d-61ea-475d-ad16-c425741d7055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:30.253138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4722682d-61ea-475d-ad16-c425741d7055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:30.254065 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4722682d-61ea-475d-ad16-c425741d7055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:30.254629 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4722682d-61ea-475d-ad16-c425741d7055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:30.318516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:30.319212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:30.329251 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:30.331159 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:30.331630 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:30.332305 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:30.360137 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:30.464421 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4722682d-61ea-475d-ad16-c425741d7055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:30.476640 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4722682d-61ea-475d-ad16-c425741d7055 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1678 microversion: 2.1 time: 0.238829 Jul 28 04:02:30.478415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 238/493] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:30 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:30.538289 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:30.549823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:30.552140 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:30.558418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8791d8f6-f63b-4618-b80c-e9e1f2a1227e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.240689 Jul 28 04:02:30.558418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 256/494] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:30 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:30.716590 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-05353f53-53f2-4af4-a1a9-4cf834dac143 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "198207d3-674a-4ae7-8a67-e2592f863c5d"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:30.719256 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-05353f53-53f2-4af4-a1a9-4cf834dac143 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:30.726122 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05353f53-53f2-4af4-a1a9-4cf834dac143 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:30.726573 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05353f53-53f2-4af4-a1a9-4cf834dac143 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:30.727376 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05353f53-53f2-4af4-a1a9-4cf834dac143 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:30.728415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05353f53-53f2-4af4-a1a9-4cf834dac143 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.506499 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-54843df9-2198-4620-bbfe-95d4e6b3cabd tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:31.514283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-54843df9-2198-4620-bbfe-95d4e6b3cabd tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:31.525967 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-54843df9-2198-4620-bbfe-95d4e6b3cabd tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.526818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-54843df9-2198-4620-bbfe-95d4e6b3cabd tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.527945 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-54843df9-2198-4620-bbfe-95d4e6b3cabd tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.528698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-54843df9-2198-4620-bbfe-95d4e6b3cabd tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.731527 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-05353f53-53f2-4af4-a1a9-4cf834dac143 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.018110 Jul 28 04:02:31.742164 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 239/495] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:02:30 2022] POST /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments => generated 194 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:31.747298 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:31.769540 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-54843df9-2198-4620-bbfe-95d4e6b3cabd tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:31.769905 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:31.783206 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.784092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.785805 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.786741 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.790745 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-54843df9-2198-4620-bbfe-95d4e6b3cabd tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1678 microversion: 2.1 time: 0.283140 Jul 28 04:02:31.791845 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 257/496] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:31 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:32.035483 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:32.051154 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:32.056371 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:32.058490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0c1cc748-23ca-4fbc-8ba9-4b4362ee5408 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1809 microversion: 2.20 time: 0.321215 Jul 28 04:02:32.059447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 240/497] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:31 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1809 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:32.828182 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-dfed3a04-438a-4309-8378-ee2a44becd7b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:32.829331 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-dfed3a04-438a-4309-8378-ee2a44becd7b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:32.840492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dfed3a04-438a-4309-8378-ee2a44becd7b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:32.841251 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dfed3a04-438a-4309-8378-ee2a44becd7b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:32.842638 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dfed3a04-438a-4309-8378-ee2a44becd7b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:32.843374 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dfed3a04-438a-4309-8378-ee2a44becd7b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:33.023843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-dfed3a04-438a-4309-8378-ee2a44becd7b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:33.037443 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-dfed3a04-438a-4309-8378-ee2a44becd7b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1678 microversion: 2.1 time: 0.216130 Jul 28 04:02:33.038323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 258/498] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:32 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:33.090392 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:33.091087 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:33.099435 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:33.100176 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:33.101360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:33.101878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:33.289033 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:33.299443 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:33.301180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:33.302405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d19660af-89e3-4d7d-883e-606e4d7842da tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1796 microversion: 2.20 time: 0.216778 Jul 28 04:02:33.302987 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 241/499] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:33 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1796 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:34.059541 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-83197ed8-9aa1-45a4-8865-14118c97b8ed tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:34.060427 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-83197ed8-9aa1-45a4-8865-14118c97b8ed tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:34.067527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-83197ed8-9aa1-45a4-8865-14118c97b8ed tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:34.068029 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-83197ed8-9aa1-45a4-8865-14118c97b8ed tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:34.068857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-83197ed8-9aa1-45a4-8865-14118c97b8ed tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:34.069300 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-83197ed8-9aa1-45a4-8865-14118c97b8ed tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:34.241068 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-83197ed8-9aa1-45a4-8865-14118c97b8ed tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:34.251629 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-83197ed8-9aa1-45a4-8865-14118c97b8ed tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1678 microversion: 2.1 time: 0.196390 Jul 28 04:02:34.252548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 259/500] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:34 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:35.283487 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7818de3d-24c9-48e8-bd42-f1ed3d830ae0 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:35.284154 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7818de3d-24c9-48e8-bd42-f1ed3d830ae0 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:35.292661 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7818de3d-24c9-48e8-bd42-f1ed3d830ae0 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:35.293118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7818de3d-24c9-48e8-bd42-f1ed3d830ae0 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:35.293915 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7818de3d-24c9-48e8-bd42-f1ed3d830ae0 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:35.294396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7818de3d-24c9-48e8-bd42-f1ed3d830ae0 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:35.458991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7818de3d-24c9-48e8-bd42-f1ed3d830ae0 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:35.473442 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7818de3d-24c9-48e8-bd42-f1ed3d830ae0 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1678 microversion: 2.1 time: 0.194075 Jul 28 04:02:35.474167 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 242/501] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:35 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:36.499556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-471c6a53-6964-4916-9dd5-4b3c9b7ef9bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:36.500582 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-471c6a53-6964-4916-9dd5-4b3c9b7ef9bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:36.508240 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-471c6a53-6964-4916-9dd5-4b3c9b7ef9bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:36.508694 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-471c6a53-6964-4916-9dd5-4b3c9b7ef9bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:36.509901 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-471c6a53-6964-4916-9dd5-4b3c9b7ef9bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:36.510351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-471c6a53-6964-4916-9dd5-4b3c9b7ef9bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:36.710984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-471c6a53-6964-4916-9dd5-4b3c9b7ef9bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:36.721298 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-471c6a53-6964-4916-9dd5-4b3c9b7ef9bf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1655 microversion: 2.1 time: 0.227617 Jul 28 04:02:36.721986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 260/502] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:36 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1655 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:36.765302 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4536920c-c784-4331-b2eb-4f2158ea9342 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:36.770092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=34 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:36.779186 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4536920c-c784-4331-b2eb-4f2158ea9342 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:36.779934 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4536920c-c784-4331-b2eb-4f2158ea9342 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:36.835116 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:36.903601 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4536920c-c784-4331-b2eb-4f2158ea9342 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Going to try to start instance {{(pid=135704) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 04:02:37.180547 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4536920c-c784-4331-b2eb-4f2158ea9342 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.422950 Jul 28 04:02:37.181596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 243/503] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:02:36 2022] POST /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:02:37.192078 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f3db4d00-af8e-4817-89b2-f3154d7c9384 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:37.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f3db4d00-af8e-4817-89b2-f3154d7c9384 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:37.202578 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f3db4d00-af8e-4817-89b2-f3154d7c9384 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:37.203328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f3db4d00-af8e-4817-89b2-f3154d7c9384 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:37.204654 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f3db4d00-af8e-4817-89b2-f3154d7c9384 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:37.213493 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f3db4d00-af8e-4817-89b2-f3154d7c9384 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:37.381600 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f3db4d00-af8e-4817-89b2-f3154d7c9384 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:37.396864 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f3db4d00-af8e-4817-89b2-f3154d7c9384 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1664 microversion: 2.1 time: 0.209400 Jul 28 04:02:37.397639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 261/504] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:37 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1664 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:38.420633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-15218bd2-031c-4acc-b434-05c22ab969fa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:38.421343 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-15218bd2-031c-4acc-b434-05c22ab969fa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:38.428294 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-15218bd2-031c-4acc-b434-05c22ab969fa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:38.428746 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-15218bd2-031c-4acc-b434-05c22ab969fa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:38.429542 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-15218bd2-031c-4acc-b434-05c22ab969fa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:38.429985 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-15218bd2-031c-4acc-b434-05c22ab969fa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:38.589602 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-15218bd2-031c-4acc-b434-05c22ab969fa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:38.597753 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-15218bd2-031c-4acc-b434-05c22ab969fa tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1664 microversion: 2.1 time: 0.182697 Jul 28 04:02:38.598352 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 244/505] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:38 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1664 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:39.625820 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b4d427dd-113c-4a95-94c5-87a0bb0f3ab5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:39.626399 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b4d427dd-113c-4a95-94c5-87a0bb0f3ab5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:39.634145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4d427dd-113c-4a95-94c5-87a0bb0f3ab5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:39.634753 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4d427dd-113c-4a95-94c5-87a0bb0f3ab5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:39.635825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4d427dd-113c-4a95-94c5-87a0bb0f3ab5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:39.636314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4d427dd-113c-4a95-94c5-87a0bb0f3ab5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:39.780429 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b4d427dd-113c-4a95-94c5-87a0bb0f3ab5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:39.788539 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b4d427dd-113c-4a95-94c5-87a0bb0f3ab5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1664 microversion: 2.1 time: 0.172474 Jul 28 04:02:39.789148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 262/506] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:39 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:40.811123 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-951c44c7-a6e6-4008-ba57-2b9f453dc6a9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:40.811782 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-951c44c7-a6e6-4008-ba57-2b9f453dc6a9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:40.818908 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-951c44c7-a6e6-4008-ba57-2b9f453dc6a9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:40.819364 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-951c44c7-a6e6-4008-ba57-2b9f453dc6a9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:40.820190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-951c44c7-a6e6-4008-ba57-2b9f453dc6a9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:40.820643 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-951c44c7-a6e6-4008-ba57-2b9f453dc6a9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.122131 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-951c44c7-a6e6-4008-ba57-2b9f453dc6a9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:41.131895 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-951c44c7-a6e6-4008-ba57-2b9f453dc6a9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1664 microversion: 2.1 time: 0.324574 Jul 28 04:02:41.140074 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 245/507] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:40 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1664 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:41.641520 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c8fe339c-b204-49b1-b456-6b52a9349303 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:41.643905 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c8fe339c-b204-49b1-b456-6b52a9349303 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:41.651618 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c8fe339c-b204-49b1-b456-6b52a9349303 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.652154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c8fe339c-b204-49b1-b456-6b52a9349303 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.652964 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c8fe339c-b204-49b1-b456-6b52a9349303 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.653416 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c8fe339c-b204-49b1-b456-6b52a9349303 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.679646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-c8fe339c-b204-49b1-b456-6b52a9349303 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lazy-loading 'flavor' on Instance uuid 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:02:42.082143 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c8fe339c-b204-49b1-b456-6b52a9349303 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/action" status: 200 len: 32 microversion: 2.1 time: 0.444617 Jul 28 04:02:42.082837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 263/508] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:02:41 2022] POST /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 04:02:42.096540 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c50d525d-a5aa-4dda-a4f5-a8b98ff82351 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:42.097252 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c50d525d-a5aa-4dda-a4f5-a8b98ff82351 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:42.106365 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c50d525d-a5aa-4dda-a4f5-a8b98ff82351 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.106828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c50d525d-a5aa-4dda-a4f5-a8b98ff82351 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:42.107816 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c50d525d-a5aa-4dda-a4f5-a8b98ff82351 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.108583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c50d525d-a5aa-4dda-a4f5-a8b98ff82351 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:42.165337 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ab847d20-719e-4db0-914d-50592253261c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:42.166104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ab847d20-719e-4db0-914d-50592253261c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:42.176609 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ab847d20-719e-4db0-914d-50592253261c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.177065 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ab847d20-719e-4db0-914d-50592253261c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:42.178157 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ab847d20-719e-4db0-914d-50592253261c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.178663 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ab847d20-719e-4db0-914d-50592253261c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:42.295816 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c50d525d-a5aa-4dda-a4f5-a8b98ff82351 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:42.309844 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c50d525d-a5aa-4dda-a4f5-a8b98ff82351 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.217786 Jul 28 04:02:42.311096 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 246/509] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:42 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:42.375188 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ab847d20-719e-4db0-914d-50592253261c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:42.383818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ab847d20-719e-4db0-914d-50592253261c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1664 microversion: 2.1 time: 0.223092 Jul 28 04:02:42.391489 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 264/510] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:42 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1664 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:43.335398 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9bbdd7e4-f677-45ae-a128-615e442afdaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:43.336070 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9bbdd7e4-f677-45ae-a128-615e442afdaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:43.343848 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9bbdd7e4-f677-45ae-a128-615e442afdaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.344338 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9bbdd7e4-f677-45ae-a128-615e442afdaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.345142 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9bbdd7e4-f677-45ae-a128-615e442afdaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.345589 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9bbdd7e4-f677-45ae-a128-615e442afdaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.417682 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-84403dd0-0621-4172-a2f3-3eb0ad681d8c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:43.417682 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-84403dd0-0621-4172-a2f3-3eb0ad681d8c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:43.420752 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-84403dd0-0621-4172-a2f3-3eb0ad681d8c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.421243 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-84403dd0-0621-4172-a2f3-3eb0ad681d8c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.422041 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-84403dd0-0621-4172-a2f3-3eb0ad681d8c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.422487 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-84403dd0-0621-4172-a2f3-3eb0ad681d8c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.516555 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9bbdd7e4-f677-45ae-a128-615e442afdaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:43.529855 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9bbdd7e4-f677-45ae-a128-615e442afdaf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.198404 Jul 28 04:02:43.530658 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 247/511] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:43 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:43.585857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-84403dd0-0621-4172-a2f3-3eb0ad681d8c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:43.595289 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-84403dd0-0621-4172-a2f3-3eb0ad681d8c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1668 microversion: 2.1 time: 0.189328 Jul 28 04:02:43.595944 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 265/512] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:43 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:44.266262 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-570f8661-21ab-46e6-a1bf-d6d8bc473c56 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.266776 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-570f8661-21ab-46e6-a1bf-d6d8bc473c56 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:44.274026 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-570f8661-21ab-46e6-a1bf-d6d8bc473c56 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.275486 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-570f8661-21ab-46e6-a1bf-d6d8bc473c56 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.276581 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-570f8661-21ab-46e6-a1bf-d6d8bc473c56 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.277116 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-570f8661-21ab-46e6-a1bf-d6d8bc473c56 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.304616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-570f8661-21ab-46e6-a1bf-d6d8bc473c56 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce/ips" status: 200 len: 151 microversion: 2.1 time: 0.043230 Jul 28 04:02:44.305220 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 248/513] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 04:02:44 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:44.320119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:44.322737 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:44.329740 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.330201 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.331011 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.331688 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.460363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Invalid volume: volume 1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b is already attached to instances: 4ce0e823-630b-4503-9b49-e9d5d43b2605 Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: POST /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce/os-volume_attachments HTTP/1.1 Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 74 Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:02:44.462937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {"volumeAttachment": {"volumeId": "1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b"}} Jul 28 04:02:44.465271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Invalid volume: volume 1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b is already attached to instances: 4ce0e823-630b-4503-9b49-e9d5d43b2605 Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'server_id': '7be29dfe-7a22-4f92-bcc4-5949f0565cce', 'body': {'volumeAttachment': {'volumeId': '1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b'}}} Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b is already attached to instances: 4ce0e823-630b-4503-9b49-e9d5d43b2605 Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:02:44.466619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b is already attached to instances: 4ce0e823-630b-4503-9b49-e9d5d43b2605 Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:44.469179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:44.471801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:44.471801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:02:44.471801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:02:44.471801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b is already attached to instances: 4ce0e823-630b-4503-9b49-e9d5d43b2605 Jul 28 04:02:44.471801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:02:44.471801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 400 to user: Invalid volume: volume 1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b is already attached to instances: 4ce0e823-630b-4503-9b49-e9d5d43b2605 {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:02:44.471801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a5c52ed2-9b5c-4669-ac44-d3143143ea50 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149382 Jul 28 04:02:44.471801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 266/514] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:02:44 2022] POST /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:02:44.477796 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-07fa4440-68ac-4328-a67e-4106b1bd542d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.479058 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-07fa4440-68ac-4328-a67e-4106b1bd542d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:44.487061 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-07fa4440-68ac-4328-a67e-4106b1bd542d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.487512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-07fa4440-68ac-4328-a67e-4106b1bd542d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.488512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-07fa4440-68ac-4328-a67e-4106b1bd542d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.488961 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-07fa4440-68ac-4328-a67e-4106b1bd542d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.521014 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-07fa4440-68ac-4328-a67e-4106b1bd542d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:02:44.556699 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-41d1ad2a-9d40-48c3-845d-0571b01089e4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.558212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-41d1ad2a-9d40-48c3-845d-0571b01089e4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:44.569531 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-41d1ad2a-9d40-48c3-845d-0571b01089e4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.570348 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-41d1ad2a-9d40-48c3-845d-0571b01089e4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.571296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-41d1ad2a-9d40-48c3-845d-0571b01089e4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.573354 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-41d1ad2a-9d40-48c3-845d-0571b01089e4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.770614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-41d1ad2a-9d40-48c3-845d-0571b01089e4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:44.781056 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-41d1ad2a-9d40-48c3-845d-0571b01089e4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.231626 Jul 28 04:02:44.781652 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 267/515] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:44 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:44.872080 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-07fa4440-68ac-4328-a67e-4106b1bd542d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 204 len: 0 microversion: 2.1 time: 0.398032 Jul 28 04:02:44.872657 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 249/516] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:02:44 2022] DELETE /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:02:44.882975 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c4317a09-3e62-4678-bee9-ac8b5e8643ee tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.884522 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c4317a09-3e62-4678-bee9-ac8b5e8643ee tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:44.893067 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4317a09-3e62-4678-bee9-ac8b5e8643ee tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.893516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4317a09-3e62-4678-bee9-ac8b5e8643ee tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.895009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4317a09-3e62-4678-bee9-ac8b5e8643ee tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.895798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4317a09-3e62-4678-bee9-ac8b5e8643ee tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:45.121933 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c4317a09-3e62-4678-bee9-ac8b5e8643ee tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:45.136878 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c4317a09-3e62-4678-bee9-ac8b5e8643ee tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1682 microversion: 2.1 time: 0.258470 Jul 28 04:02:45.137812 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 268/517] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:44 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1682 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:45.807642 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e1f369a8-9848-449b-a6cc-aaefe37237a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:45.808405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e1f369a8-9848-449b-a6cc-aaefe37237a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:45.815294 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e1f369a8-9848-449b-a6cc-aaefe37237a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:45.815753 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e1f369a8-9848-449b-a6cc-aaefe37237a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:45.816567 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e1f369a8-9848-449b-a6cc-aaefe37237a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:45.817065 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e1f369a8-9848-449b-a6cc-aaefe37237a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:45.965316 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e1f369a8-9848-449b-a6cc-aaefe37237a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:45.982323 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e1f369a8-9848-449b-a6cc-aaefe37237a4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.179427 Jul 28 04:02:45.983288 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 250/518] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:45 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:46.165054 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-26d2f49c-61ff-44ec-b4df-0eeee32484ba tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:46.171872 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-26d2f49c-61ff-44ec-b4df-0eeee32484ba tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:46.177531 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-26d2f49c-61ff-44ec-b4df-0eeee32484ba tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:46.178102 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-26d2f49c-61ff-44ec-b4df-0eeee32484ba tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:46.179376 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-26d2f49c-61ff-44ec-b4df-0eeee32484ba tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:46.179698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-26d2f49c-61ff-44ec-b4df-0eeee32484ba tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:46.379498 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-26d2f49c-61ff-44ec-b4df-0eeee32484ba tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:46.393115 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-26d2f49c-61ff-44ec-b4df-0eeee32484ba tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1682 microversion: 2.1 time: 0.235347 Jul 28 04:02:46.393949 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 269/519] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:46 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:47.011378 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3e0f5933-7b0a-4752-bfef-ed85f92c290e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:47.014029 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3e0f5933-7b0a-4752-bfef-ed85f92c290e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:47.029451 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3e0f5933-7b0a-4752-bfef-ed85f92c290e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.031153 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3e0f5933-7b0a-4752-bfef-ed85f92c290e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.031851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3e0f5933-7b0a-4752-bfef-ed85f92c290e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.032674 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3e0f5933-7b0a-4752-bfef-ed85f92c290e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.226155 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-3e0f5933-7b0a-4752-bfef-ed85f92c290e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:47.236063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3e0f5933-7b0a-4752-bfef-ed85f92c290e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.233888 Jul 28 04:02:47.236663 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 251/520] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:47 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:47.419112 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6915a468-6753-4227-99a3-b25df7b2d741 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:47.420106 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6915a468-6753-4227-99a3-b25df7b2d741 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:47.432701 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6915a468-6753-4227-99a3-b25df7b2d741 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.433506 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6915a468-6753-4227-99a3-b25df7b2d741 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.434976 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6915a468-6753-4227-99a3-b25df7b2d741 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.435790 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6915a468-6753-4227-99a3-b25df7b2d741 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.539784 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6915a468-6753-4227-99a3-b25df7b2d741 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:47.566315 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6915a468-6753-4227-99a3-b25df7b2d741 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1615 microversion: 2.1 time: 0.137710 Jul 28 04:02:47.566315 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 270/521] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:47 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1615 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:47.646844 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-8fadb0c2-9d99-41e2-9af5-f8cb0b226038 req-85fd39b8-4e7f-4c6f-8ab8-cd0a86387a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be29dfe-7a22-4f92-bcc4-5949f0565cce", "name": "network-vif-deleted", "tag": "7b825057-8fcf-4f6a-a139-762e2220c27f"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:47.660274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-8fadb0c2-9d99-41e2-9af5-f8cb0b226038 req-85fd39b8-4e7f-4c6f-8ab8-cd0a86387a74 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.660880 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-8fadb0c2-9d99-41e2-9af5-f8cb0b226038 req-85fd39b8-4e7f-4c6f-8ab8-cd0a86387a74 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.675601 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-8fadb0c2-9d99-41e2-9af5-f8cb0b226038 req-85fd39b8-4e7f-4c6f-8ab8-cd0a86387a74 service nova] Creating event network-vif-deleted:7b825057-8fcf-4f6a-a139-762e2220c27f for instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce on hv-cinder-85127 Jul 28 04:02:47.683099 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-8fadb0c2-9d99-41e2-9af5-f8cb0b226038 req-85fd39b8-4e7f-4c6f-8ab8-cd0a86387a74 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039883 Jul 28 04:02:47.684184 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 252/522] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:48.265608 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8bd1e78f-82f6-4b8b-9746-fd03167e7e2e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:48.268548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8bd1e78f-82f6-4b8b-9746-fd03167e7e2e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:48.278081 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8bd1e78f-82f6-4b8b-9746-fd03167e7e2e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.279368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8bd1e78f-82f6-4b8b-9746-fd03167e7e2e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.281676 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8bd1e78f-82f6-4b8b-9746-fd03167e7e2e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.284196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8bd1e78f-82f6-4b8b-9746-fd03167e7e2e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.294600 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:48.579006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:48.579833 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:48.591008 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.591777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.592857 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.593481 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.618629 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8bd1e78f-82f6-4b8b-9746-fd03167e7e2e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:48.637134 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8bd1e78f-82f6-4b8b-9746-fd03167e7e2e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.379114 Jul 28 04:02:48.651780 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 271/523] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:48 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:48.667699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.668561 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.669474 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lazy-loading 'fault' on Instance uuid 7be29dfe-7a22-4f92-bcc4-5949f0565cce {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:02:48.793384 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:48.815041 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a09bc2b2-33b5-4e39-a50e-6f7d8e7ac104 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 200 len: 1331 microversion: 2.1 time: 0.241710 Jul 28 04:02:48.816479 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 253/524] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:48 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 1331 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:49.671448 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e43a47c1-24ea-4825-834d-933fca2c209f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:49.673220 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e43a47c1-24ea-4825-834d-933fca2c209f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:49.689699 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e43a47c1-24ea-4825-834d-933fca2c209f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.690510 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e43a47c1-24ea-4825-834d-933fca2c209f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.692106 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e43a47c1-24ea-4825-834d-933fca2c209f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.692884 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e43a47c1-24ea-4825-834d-933fca2c209f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.867011 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:49.868170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:49.881161 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.881909 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.883319 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.884177 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.907989 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce HTTP/1.1 Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:02:49.910777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:02:49.915082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '7be29dfe-7a22-4f92-bcc4-5949f0565cce'} Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:02:49.919336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:02:49.924777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.929098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:02:49.929098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d42626bc-f806-48f8-9204-70acbef3b90f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 404 len: 111 microversion: 2.1 time: 0.053756 Jul 28 04:02:49.929098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 254/525] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:49 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:02:49.930302 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-79e80a35-6264-4fe6-bbeb-24ef47b42f72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '.version_select at 0x7f5572e5d040>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:49.941034 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-e43a47c1-24ea-4825-834d-933fca2c209f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:49.951250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e43a47c1-24ea-4825-834d-933fca2c209f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.295808 Jul 28 04:02:49.952943 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 272/526] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:49 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:50.032868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-79e80a35-6264-4fe6-bbeb-24ef47b42f72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137906234" status: 202 len: 0 microversion: 2.1 time: 0.110441 Jul 28 04:02:50.033903 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 255/527] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Jul 28 04:02:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137906234 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:02:50.981294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-de1e7d9f-162e-4252-ad6e-e435afdbff18 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:50.982025 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-de1e7d9f-162e-4252-ad6e-e435afdbff18 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:50.989333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-de1e7d9f-162e-4252-ad6e-e435afdbff18 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:50.989790 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-de1e7d9f-162e-4252-ad6e-e435afdbff18 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:50.990600 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-de1e7d9f-162e-4252-ad6e-e435afdbff18 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:50.991053 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-de1e7d9f-162e-4252-ad6e-e435afdbff18 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.323159 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-de1e7d9f-162e-4252-ad6e-e435afdbff18 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:51.345541 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-de1e7d9f-162e-4252-ad6e-e435afdbff18 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.368814 Jul 28 04:02:51.346636 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 273/528] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:50 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:51.397157 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-25afb6b8-0430-4cf8-a5cf-99ba9d8cb100 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:51.398014 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-25afb6b8-0430-4cf8-a5cf-99ba9d8cb100 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:51.413252 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-25afb6b8-0430-4cf8-a5cf-99ba9d8cb100 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:51.414545 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-25afb6b8-0430-4cf8-a5cf-99ba9d8cb100 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.416137 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-25afb6b8-0430-4cf8-a5cf-99ba9d8cb100 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:51.417555 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-25afb6b8-0430-4cf8-a5cf-99ba9d8cb100 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.537236 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-25afb6b8-0430-4cf8-a5cf-99ba9d8cb100 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lazy-loading 'services' on Instance uuid 4ce0e823-630b-4503-9b49-e9d5d43b2605 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:02:51.812520 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-25afb6b8-0430-4cf8-a5cf-99ba9d8cb100 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments/1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b" status: 202 len: 0 microversion: 2.1 time: 0.422942 Jul 28 04:02:51.813063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 256/529] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:02:51 2022] DELETE /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments/1d3ae06c-0bc4-44c3-86b3-2d7ddb8cf91b => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:02:51.823020 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-18478e56-d82a-4b27-bb27-6e6e4b9f2aea tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:51.825477 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-18478e56-d82a-4b27-bb27-6e6e4b9f2aea tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:51.832384 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-18478e56-d82a-4b27-bb27-6e6e4b9f2aea tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:51.832840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-18478e56-d82a-4b27-bb27-6e6e4b9f2aea tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.833650 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-18478e56-d82a-4b27-bb27-6e6e4b9f2aea tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:51.834092 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-18478e56-d82a-4b27-bb27-6e6e4b9f2aea tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.872386 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-18478e56-d82a-4b27-bb27-6e6e4b9f2aea tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054285 Jul 28 04:02:51.872991 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 274/530] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:02:51 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:52.370324 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-acb53c43-4ef3-4d1c-9b3e-31739ba1a2bf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:52.370946 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-acb53c43-4ef3-4d1c-9b3e-31739ba1a2bf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:52.378807 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-acb53c43-4ef3-4d1c-9b3e-31739ba1a2bf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:52.379025 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-acb53c43-4ef3-4d1c-9b3e-31739ba1a2bf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:52.379744 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-acb53c43-4ef3-4d1c-9b3e-31739ba1a2bf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:52.380245 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-acb53c43-4ef3-4d1c-9b3e-31739ba1a2bf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:52.575374 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-acb53c43-4ef3-4d1c-9b3e-31739ba1a2bf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:52.593908 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-acb53c43-4ef3-4d1c-9b3e-31739ba1a2bf tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.228534 Jul 28 04:02:52.596531 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 257/531] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:52 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:52.887940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d596641c-d0ef-4f10-9184-c17d260f144f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:52.891395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d596641c-d0ef-4f10-9184-c17d260f144f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:52.894860 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=54 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:52.904618 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d596641c-d0ef-4f10-9184-c17d260f144f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:52.909415 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d596641c-d0ef-4f10-9184-c17d260f144f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:52.909415 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d596641c-d0ef-4f10-9184-c17d260f144f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:52.909415 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d596641c-d0ef-4f10-9184-c17d260f144f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:52.972239 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d596641c-d0ef-4f10-9184-c17d260f144f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088647 Jul 28 04:02:52.972239 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 275/532] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:02:52 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:53.619364 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-919e105e-8414-4997-b93f-16d2b4d8c1a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:53.620796 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-919e105e-8414-4997-b93f-16d2b4d8c1a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:53.627683 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-919e105e-8414-4997-b93f-16d2b4d8c1a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:53.628209 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-919e105e-8414-4997-b93f-16d2b4d8c1a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:53.629008 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-919e105e-8414-4997-b93f-16d2b4d8c1a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:53.629453 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-919e105e-8414-4997-b93f-16d2b4d8c1a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:53.804586 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-919e105e-8414-4997-b93f-16d2b4d8c1a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:53.807432 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:53.815410 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-919e105e-8414-4997-b93f-16d2b4d8c1a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.200505 Jul 28 04:02:53.816032 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 258/533] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:53 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:53.985639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-98f7b517-1aca-4711-89a2-a8087bd0cc2c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:53.987938 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-98f7b517-1aca-4711-89a2-a8087bd0cc2c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:53.995683 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-98f7b517-1aca-4711-89a2-a8087bd0cc2c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:53.996199 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-98f7b517-1aca-4711-89a2-a8087bd0cc2c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:53.997586 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-98f7b517-1aca-4711-89a2-a8087bd0cc2c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:53.998040 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-98f7b517-1aca-4711-89a2-a8087bd0cc2c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:54.032573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-98f7b517-1aca-4711-89a2-a8087bd0cc2c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050894 Jul 28 04:02:54.033336 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 276/534] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:02:53 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:02:54.134699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c3e0be54-0efa-4c22-be07-a97dd87db65e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:54.135435 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c3e0be54-0efa-4c22-be07-a97dd87db65e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:54.143929 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c3e0be54-0efa-4c22-be07-a97dd87db65e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:54.150523 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c3e0be54-0efa-4c22-be07-a97dd87db65e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:54.150523 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c3e0be54-0efa-4c22-be07-a97dd87db65e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:54.150523 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c3e0be54-0efa-4c22-be07-a97dd87db65e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:54.181201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c3e0be54-0efa-4c22-be07-a97dd87db65e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:02:54.608656 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c3e0be54-0efa-4c22-be07-a97dd87db65e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 204 len: 0 microversion: 2.1 time: 0.477563 Jul 28 04:02:54.609297 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 259/535] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:02:54 2022] DELETE /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:02:54.623222 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c9d891d7-31f0-4c7f-971b-bcd619538a35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:54.627526 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c9d891d7-31f0-4c7f-971b-bcd619538a35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:54.635859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c9d891d7-31f0-4c7f-971b-bcd619538a35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:54.636609 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c9d891d7-31f0-4c7f-971b-bcd619538a35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:54.638027 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c9d891d7-31f0-4c7f-971b-bcd619538a35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:54.638830 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c9d891d7-31f0-4c7f-971b-bcd619538a35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:54.849195 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c9d891d7-31f0-4c7f-971b-bcd619538a35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:54.854148 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4884a694-9802-419d-811b-d5a21b75b35a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:54.855481 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4884a694-9802-419d-811b-d5a21b75b35a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:54.859778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c9d891d7-31f0-4c7f-971b-bcd619538a35 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1680 microversion: 2.1 time: 0.243903 Jul 28 04:02:54.860627 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 277/536] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:54 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:54.876111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4884a694-9802-419d-811b-d5a21b75b35a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:54.876111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4884a694-9802-419d-811b-d5a21b75b35a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:54.876111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4884a694-9802-419d-811b-d5a21b75b35a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:54.876111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4884a694-9802-419d-811b-d5a21b75b35a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:55.082163 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4884a694-9802-419d-811b-d5a21b75b35a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:55.098942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4884a694-9802-419d-811b-d5a21b75b35a tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.251016 Jul 28 04:02:55.100355 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 260/537] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:54 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:55.883442 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5c564bb7-6b17-4ff8-95bf-c36a3498f205 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:55.884763 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5c564bb7-6b17-4ff8-95bf-c36a3498f205 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:55.892189 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5c564bb7-6b17-4ff8-95bf-c36a3498f205 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:55.892647 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5c564bb7-6b17-4ff8-95bf-c36a3498f205 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:55.893452 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5c564bb7-6b17-4ff8-95bf-c36a3498f205 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:55.893895 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5c564bb7-6b17-4ff8-95bf-c36a3498f205 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:56.061608 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5c564bb7-6b17-4ff8-95bf-c36a3498f205 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:56.072165 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5c564bb7-6b17-4ff8-95bf-c36a3498f205 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1680 microversion: 2.1 time: 0.192050 Jul 28 04:02:56.072508 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 278/538] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:55 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:56.139984 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-175f12a4-24cd-4e0f-9afe-8b74d32891d8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:56.140918 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-175f12a4-24cd-4e0f-9afe-8b74d32891d8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:56.147755 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-175f12a4-24cd-4e0f-9afe-8b74d32891d8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:56.148248 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-175f12a4-24cd-4e0f-9afe-8b74d32891d8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:56.149078 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-175f12a4-24cd-4e0f-9afe-8b74d32891d8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:56.150512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-175f12a4-24cd-4e0f-9afe-8b74d32891d8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:56.325612 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-175f12a4-24cd-4e0f-9afe-8b74d32891d8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:56.338693 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-175f12a4-24cd-4e0f-9afe-8b74d32891d8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.202772 Jul 28 04:02:56.339343 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 261/539] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:56 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:57.100557 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-74d80706-b59d-475f-860b-a42c3f4ecb18 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:57.101707 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-74d80706-b59d-475f-860b-a42c3f4ecb18 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:57.113937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-74d80706-b59d-475f-860b-a42c3f4ecb18 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:57.114750 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-74d80706-b59d-475f-860b-a42c3f4ecb18 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:57.116219 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-74d80706-b59d-475f-860b-a42c3f4ecb18 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:57.117009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-74d80706-b59d-475f-860b-a42c3f4ecb18 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:57.328341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-74d80706-b59d-475f-860b-a42c3f4ecb18 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:57.340892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-74d80706-b59d-475f-860b-a42c3f4ecb18 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1680 microversion: 2.1 time: 0.247713 Jul 28 04:02:57.341732 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 279/540] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:57 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1680 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:57.360943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0178a110-6ca8-4f35-94ab-8403cfe8af30 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:57.361754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0178a110-6ca8-4f35-94ab-8403cfe8af30 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:57.373078 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0178a110-6ca8-4f35-94ab-8403cfe8af30 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:57.373777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0178a110-6ca8-4f35-94ab-8403cfe8af30 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:57.381615 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0178a110-6ca8-4f35-94ab-8403cfe8af30 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:57.381615 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0178a110-6ca8-4f35-94ab-8403cfe8af30 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:57.608261 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0178a110-6ca8-4f35-94ab-8403cfe8af30 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:57.616629 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0178a110-6ca8-4f35-94ab-8403cfe8af30 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.259469 Jul 28 04:02:57.617589 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 262/541] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:57 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:58.255246 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-fd50e0a7-23cb-4f75-8a51-8b54421c6a68 req-2d98e6c1-7e32-4cb8-bac4-b3ff058607c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce0e823-630b-4503-9b49-e9d5d43b2605", "name": "network-vif-deleted", "tag": "fb9b0d27-d368-47b4-869d-588f9411de37"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:58.268044 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-fd50e0a7-23cb-4f75-8a51-8b54421c6a68 req-2d98e6c1-7e32-4cb8-bac4-b3ff058607c4 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:58.268823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-fd50e0a7-23cb-4f75-8a51-8b54421c6a68 req-2d98e6c1-7e32-4cb8-bac4-b3ff058607c4 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:58.285265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-fd50e0a7-23cb-4f75-8a51-8b54421c6a68 req-2d98e6c1-7e32-4cb8-bac4-b3ff058607c4 service nova] Creating event network-vif-deleted:fb9b0d27-d368-47b4-869d-588f9411de37 for instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 on hv-cinder-85127 Jul 28 04:02:58.293060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-fd50e0a7-23cb-4f75-8a51-8b54421c6a68 req-2d98e6c1-7e32-4cb8-bac4-b3ff058607c4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041836 Jul 28 04:02:58.294301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 280/542] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:58.386017 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-64e035a7-97a5-490d-85f8-8e5032b49786 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:58.389179 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-64e035a7-97a5-490d-85f8-8e5032b49786 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:58.411165 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-64e035a7-97a5-490d-85f8-8e5032b49786 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:58.412411 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-64e035a7-97a5-490d-85f8-8e5032b49786 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:58.413929 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-64e035a7-97a5-490d-85f8-8e5032b49786 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:58.414819 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-64e035a7-97a5-490d-85f8-8e5032b49786 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:58.510314 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-64e035a7-97a5-490d-85f8-8e5032b49786 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:58.521271 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-64e035a7-97a5-490d-85f8-8e5032b49786 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1613 microversion: 2.1 time: 0.148815 Jul 28 04:02:58.521862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 263/543] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:58 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1613 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:58.640095 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ba800570-7b7c-43d1-96fd-f527db4a51ff tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:58.640868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ba800570-7b7c-43d1-96fd-f527db4a51ff tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:58.647153 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ba800570-7b7c-43d1-96fd-f527db4a51ff tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:58.647609 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ba800570-7b7c-43d1-96fd-f527db4a51ff tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:58.648589 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ba800570-7b7c-43d1-96fd-f527db4a51ff tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:58.649038 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ba800570-7b7c-43d1-96fd-f527db4a51ff tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:58.796806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ba800570-7b7c-43d1-96fd-f527db4a51ff tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:58.805577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ba800570-7b7c-43d1-96fd-f527db4a51ff tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.169760 Jul 28 04:02:58.806815 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 281/544] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:58 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:59.551132 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:59.552503 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:59.559726 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:59.560222 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:59.561190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:59.561889 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:59.598550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:59.599116 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:59.599593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lazy-loading 'fault' on Instance uuid 4ce0e823-630b-4503-9b49-e9d5d43b2605 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:02:59.668692 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:59.676504 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8a11f7bf-793a-410b-aa00-e2585b67badd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 200 len: 1330 microversion: 2.1 time: 0.129781 Jul 28 04:02:59.677087 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 264/545] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:59 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 1330 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:59.829971 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-eb92b479-fa59-4485-b59f-965eee1b5dc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:59.830625 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-eb92b479-fa59-4485-b59f-965eee1b5dc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:59.837882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eb92b479-fa59-4485-b59f-965eee1b5dc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:59.838113 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eb92b479-fa59-4485-b59f-965eee1b5dc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:59.838891 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eb92b479-fa59-4485-b59f-965eee1b5dc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:59.839336 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eb92b479-fa59-4485-b59f-965eee1b5dc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:00.020017 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-eb92b479-fa59-4485-b59f-965eee1b5dc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:00.029390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-eb92b479-fa59-4485-b59f-965eee1b5dc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.203322 Jul 28 04:03:00.034487 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 282/546] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:59 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:00.698731 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:00.699416 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:00.706176 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:00.706624 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:00.707399 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:00.707832 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:00.725225 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 HTTP/1.1 Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:03:00.726870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:03:00.729356 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '4ce0e823-630b-4503-9b49-e9d5d43b2605'} Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:00.730230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:03:00.731358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:00.732407 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:00.732407 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-990d11fb-196d-4314-9b3c-cddc51937b9a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 404 len: 111 microversion: 2.1 time: 0.034939 Jul 28 04:03:00.732407 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 265/547] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:00 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:03:00.739318 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ac67d0f3-28be-4de4-be92-387b99c887a1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '.version_select at 0x7f5572e8a3a0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:00.836479 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ac67d0f3-28be-4de4-be92-387b99c887a1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-908294098" status: 202 len: 0 microversion: 2.1 time: 0.101346 Jul 28 04:03:00.838071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 283/548] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Jul 28 04:03:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-908294098 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:03:01.069464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-29abd84f-e0d0-4e7e-b45c-3fe342261202 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:01.069935 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-29abd84f-e0d0-4e7e-b45c-3fe342261202 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:01.081062 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-29abd84f-e0d0-4e7e-b45c-3fe342261202 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:01.081851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-29abd84f-e0d0-4e7e-b45c-3fe342261202 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:01.083252 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-29abd84f-e0d0-4e7e-b45c-3fe342261202 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:01.084231 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-29abd84f-e0d0-4e7e-b45c-3fe342261202 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:01.492059 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-29abd84f-e0d0-4e7e-b45c-3fe342261202 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:01.501361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-29abd84f-e0d0-4e7e-b45c-3fe342261202 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1738 microversion: 2.1 time: 0.439673 Jul 28 04:03:01.502192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 266/549] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:01 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1738 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:01.923743 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-61448064-0932-43e6-b413-e1fe9ce18d14 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: .version_select at 0x7f5572ec2040>, body: {"keypair": {"name": "tempest-keypair-1955297559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl4nkl8STsWS6483G4NJj1Wc74vMyOImtv4RRwbCf8pYon6zOGd9Dw7lCfn/3QJfJ+EvWoPsiwR9rIZGW5D8JT1mhAHoBJexJofCBKiMaVzJ/tyfJQ6gB7ghKgRJDWL0A=="}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:01.942664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-61448064-0932-43e6-b413-e1fe9ce18d14 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for project f68fb083db524ab59ba49d71ae754ba0. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:01.947789 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-61448064-0932-43e6-b413-e1fe9ce18d14 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for user 37b7380889a4411cb57465ab5d33ba75 and project f68fb083db524ab59ba49d71ae754ba0. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:02.073940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-61448064-0932-43e6-b413-e1fe9ce18d14 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154972 Jul 28 04:03:02.074988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 284/550] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 04:03:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:02.524307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9b09d89a-9d0c-491b-876f-91e20cda3c82 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:02.525063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9b09d89a-9d0c-491b-876f-91e20cda3c82 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:02.536208 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9b09d89a-9d0c-491b-876f-91e20cda3c82 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:02.537128 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9b09d89a-9d0c-491b-876f-91e20cda3c82 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:02.538153 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9b09d89a-9d0c-491b-876f-91e20cda3c82 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:02.538749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9b09d89a-9d0c-491b-876f-91e20cda3c82 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:02.710530 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9b09d89a-9d0c-491b-876f-91e20cda3c82 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:02.719279 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9b09d89a-9d0c-491b-876f-91e20cda3c82 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1718 microversion: 2.1 time: 0.198974 Jul 28 04:03:02.719862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 267/551] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:02 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1718 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:02.838021 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:02.838524 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:02.844792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:02.845259 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:02.846047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:02.846512 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:02.981128 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] HTTP exception thrown: Cannot 'detach_volume' instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b while it is in vm_state rescued Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Request method failure captured: Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: DELETE /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments/198207d3-674a-4ae7-8a67-e2592f863c5d HTTP/1.1 Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmKWLvqHiajw7Vtw-f2vvp_0YIjU3hSWiY17ioucOls7t40OrsIG6OSQelvM8vSidvlTrUkQl_D2V_jlVb0xPoWv0cI31HO1ossk5jJ2gT7TKd33Bz9cKC_3eCS5JpW3XRsx57me7iAOdWTxirrq9O4DR5qeUqvuAN28zh0ABaN-l0 Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:03:02.988323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8bf7f0f7880a435ba552361bcb31ef91", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}] Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 4251e84650f047c9a6eb0c3b16b25564 Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:03:02.989614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Cannot 'detach_volume' instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b while it is in vm_state rescued Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'server_id': '4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b', 'id': '198207d3-674a-4ae7-8a67-e2592f863c5d'} Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:02.990343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b while it is in vm_state rescued Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b while it is in vm_state rescued Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:02.991496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Returning 409 to user: Cannot 'detach_volume' instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b while it is in vm_state rescued {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:02.992453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-81f96b93-bd21-4d36-bfb0-6512e17d6e04 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments/198207d3-674a-4ae7-8a67-e2592f863c5d" status: 409 len: 152 microversion: 2.1 time: 0.150838 Jul 28 04:03:02.992453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 285/552] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:03:02 2022] DELETE /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments/198207d3-674a-4ae7-8a67-e2592f863c5d => generated 152 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:03:02.993885 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-04c5eb1e-f966-4c7d-8f1e-25be5a2937a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:02.994386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-04c5eb1e-f966-4c7d-8f1e-25be5a2937a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:03.000700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-04c5eb1e-f966-4c7d-8f1e-25be5a2937a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:03.001366 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-04c5eb1e-f966-4c7d-8f1e-25be5a2937a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:03.002144 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-04c5eb1e-f966-4c7d-8f1e-25be5a2937a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:03.002583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-04c5eb1e-f966-4c7d-8f1e-25be5a2937a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:03.361542 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-04c5eb1e-f966-4c7d-8f1e-25be5a2937a3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "POST /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/action" status: 202 len: 0 microversion: 2.1 time: 0.371992 Jul 28 04:03:03.362242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 268/553] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:03:02 2022] POST /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:03:03.374444 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-59402fa1-693e-4c2c-80c4-300e97d9000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:03.375365 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-59402fa1-693e-4c2c-80c4-300e97d9000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:03.400988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59402fa1-693e-4c2c-80c4-300e97d9000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:03.400988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59402fa1-693e-4c2c-80c4-300e97d9000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:03.400988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59402fa1-693e-4c2c-80c4-300e97d9000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:03.400988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59402fa1-693e-4c2c-80c4-300e97d9000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:03.578062 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-59402fa1-693e-4c2c-80c4-300e97d9000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:03.595429 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-59402fa1-693e-4c2c-80c4-300e97d9000e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1726 microversion: 2.1 time: 0.225403 Jul 28 04:03:03.596625 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 286/554] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:03 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1726 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:04.636008 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-adc6949d-a75d-49d8-9883-4d1956b6a322 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:04.636855 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-adc6949d-a75d-49d8-9883-4d1956b6a322 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:04.645208 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-adc6949d-a75d-49d8-9883-4d1956b6a322 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:04.645688 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-adc6949d-a75d-49d8-9883-4d1956b6a322 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:04.646631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-adc6949d-a75d-49d8-9883-4d1956b6a322 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:04.647102 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-adc6949d-a75d-49d8-9883-4d1956b6a322 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:04.873205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-adc6949d-a75d-49d8-9883-4d1956b6a322 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:04.883051 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-adc6949d-a75d-49d8-9883-4d1956b6a322 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1726 microversion: 2.1 time: 0.255603 Jul 28 04:03:04.883729 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 269/555] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:04 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1726 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:05.621541 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1577724923", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cf9021b-c509-4bfd-870b-1ff5c987c7dd"}], "security_groups": [{"name": "tempest-securitygroup--200182269"}], "key_name": "tempest-keypair-1955297559", "user_data": "}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:05.735422 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] validate_networks() for [('9cf9021b-c509-4bfd-870b-1ff5c987c7dd', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:03:05.905698 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-65ec9da0-a05d-4982-953a-1d962c272e31 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:05.906321 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-65ec9da0-a05d-4982-953a-1d962c272e31 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:05.914493 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65ec9da0-a05d-4982-953a-1d962c272e31 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:05.915741 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65ec9da0-a05d-4982-953a-1d962c272e31 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:05.916638 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65ec9da0-a05d-4982-953a-1d962c272e31 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:05.917252 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65ec9da0-a05d-4982-953a-1d962c272e31 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:06.096829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-65ec9da0-a05d-4982-953a-1d962c272e31 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:06.112304 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-65ec9da0-a05d-4982-953a-1d962c272e31 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1726 microversion: 2.1 time: 0.210026 Jul 28 04:03:06.113358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 270/556] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:05 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:06.557814 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:03:06.558384 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:03:06.559003 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:03:06.559508 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:03:06.560359 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:03:06.570404 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:06.570885 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:06.571759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:06.572289 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:06.592376 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for project f68fb083db524ab59ba49d71ae754ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:06.597285 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for user 37b7380889a4411cb57465ab5d33ba75 and project f68fb083db524ab59ba49d71ae754ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:06.612490 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:03:06.615041 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:03:06.739521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-07f90abe-c11f-4a10-845d-7b5e2a8dd65c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.122975 Jul 28 04:03:06.740759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 287/557] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:03:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:03:06.758644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-02966474-6150-4e2a-abef-3814842d067a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:06.759191 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-02966474-6150-4e2a-abef-3814842d067a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:06.841049 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-02966474-6150-4e2a-abef-3814842d067a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:06.849919 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-02966474-6150-4e2a-abef-3814842d067a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1242 microversion: 2.1 time: 0.099284 Jul 28 04:03:06.851115 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 271/558] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:06 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:07.137492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5d217c02-cacf-4f80-b475-cc38b4ccc490 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:07.138843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5d217c02-cacf-4f80-b475-cc38b4ccc490 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:07.146429 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5d217c02-cacf-4f80-b475-cc38b4ccc490 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.146887 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5d217c02-cacf-4f80-b475-cc38b4ccc490 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.147680 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5d217c02-cacf-4f80-b475-cc38b4ccc490 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.148321 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5d217c02-cacf-4f80-b475-cc38b4ccc490 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.318090 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5d217c02-cacf-4f80-b475-cc38b4ccc490 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:07.330656 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5d217c02-cacf-4f80-b475-cc38b4ccc490 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1732 microversion: 2.1 time: 0.197398 Jul 28 04:03:07.331629 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 288/559] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:07 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:07.357344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ef851ba4-7ac3-41f0-8bc5-9d223c1abd59 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:07.357919 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ef851ba4-7ac3-41f0-8bc5-9d223c1abd59 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:07.360546 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:07.366033 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef851ba4-7ac3-41f0-8bc5-9d223c1abd59 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.369617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef851ba4-7ac3-41f0-8bc5-9d223c1abd59 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.369617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef851ba4-7ac3-41f0-8bc5-9d223c1abd59 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.369617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef851ba4-7ac3-41f0-8bc5-9d223c1abd59 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.459793 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ef851ba4-7ac3-41f0-8bc5-9d223c1abd59 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107132 Jul 28 04:03:07.460458 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 272/560] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Jul 28 04:03:07 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:07.878339 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-338f03b4-5bbc-4c1e-9691-57c62cffa504 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:07.879468 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-338f03b4-5bbc-4c1e-9691-57c62cffa504 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:07.903946 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-338f03b4-5bbc-4c1e-9691-57c62cffa504 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.904786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-338f03b4-5bbc-4c1e-9691-57c62cffa504 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.906272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-338f03b4-5bbc-4c1e-9691-57c62cffa504 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.915076 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-338f03b4-5bbc-4c1e-9691-57c62cffa504 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:08.039460 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-338f03b4-5bbc-4c1e-9691-57c62cffa504 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:08.049270 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-338f03b4-5bbc-4c1e-9691-57c62cffa504 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1246 microversion: 2.1 time: 0.178869 Jul 28 04:03:08.050191 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 289/561] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:07 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1246 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:08.993129 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-0cddce87-6aa1-4e05-a185-6cd589cb25d9 req-d82b171c-0c9d-4182-85bd-ab5038aa3458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b", "tag": "d2c58462-fb66-479c-9106-a98477b390b4"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:09.010250 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-0cddce87-6aa1-4e05-a185-6cd589cb25d9 req-d82b171c-0c9d-4182-85bd-ab5038aa3458 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:09.011363 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-0cddce87-6aa1-4e05-a185-6cd589cb25d9 req-d82b171c-0c9d-4182-85bd-ab5038aa3458 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:09.038470 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-0cddce87-6aa1-4e05-a185-6cd589cb25d9 req-d82b171c-0c9d-4182-85bd-ab5038aa3458 service nova] Creating event network-changed:d2c58462-fb66-479c-9106-a98477b390b4 for instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b on hv-cinder-85127 Jul 28 04:03:09.050065 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-0cddce87-6aa1-4e05-a185-6cd589cb25d9 req-d82b171c-0c9d-4182-85bd-ab5038aa3458 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064933 Jul 28 04:03:09.051109 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 273/562] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:09.089861 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3a32e99d-ef21-4160-bbfb-363531a8a8c4 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:09.092012 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3a32e99d-ef21-4160-bbfb-363531a8a8c4 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:09.103189 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3a32e99d-ef21-4160-bbfb-363531a8a8c4 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:09.103189 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3a32e99d-ef21-4160-bbfb-363531a8a8c4 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:09.104573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3a32e99d-ef21-4160-bbfb-363531a8a8c4 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:09.105133 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3a32e99d-ef21-4160-bbfb-363531a8a8c4 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:09.185854 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3a32e99d-ef21-4160-bbfb-363531a8a8c4 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:09.201385 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3a32e99d-ef21-4160-bbfb-363531a8a8c4 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1294 microversion: 2.1 time: 0.119207 Jul 28 04:03:09.217995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 290/563] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:09 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1294 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:10.244297 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0e7a7ae2-45f6-4152-8c0c-f65be5af4704 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:10.245624 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0e7a7ae2-45f6-4152-8c0c-f65be5af4704 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:10.257831 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0e7a7ae2-45f6-4152-8c0c-f65be5af4704 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:10.258630 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0e7a7ae2-45f6-4152-8c0c-f65be5af4704 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:10.260527 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0e7a7ae2-45f6-4152-8c0c-f65be5af4704 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:10.261049 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0e7a7ae2-45f6-4152-8c0c-f65be5af4704 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:10.378645 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0e7a7ae2-45f6-4152-8c0c-f65be5af4704 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:10.397084 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0e7a7ae2-45f6-4152-8c0c-f65be5af4704 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1300 microversion: 2.1 time: 0.162011 Jul 28 04:03:10.397969 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 274/564] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:10 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:11.087894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-a6cf8e83-8e5b-4a9b-9a13-a07a4a8b4d1b req-ab8c244b-db7a-4483-8d97-503956c5af4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b", "tag": "d2c58462-fb66-479c-9106-a98477b390b4"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:11.105034 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-a6cf8e83-8e5b-4a9b-9a13-a07a4a8b4d1b req-ab8c244b-db7a-4483-8d97-503956c5af4d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:11.105490 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-a6cf8e83-8e5b-4a9b-9a13-a07a4a8b4d1b req-ab8c244b-db7a-4483-8d97-503956c5af4d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:11.109752 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=100 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:11.121017 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-a6cf8e83-8e5b-4a9b-9a13-a07a4a8b4d1b req-ab8c244b-db7a-4483-8d97-503956c5af4d service nova] Creating event network-changed:d2c58462-fb66-479c-9106-a98477b390b4 for instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b on hv-cinder-85127 Jul 28 04:03:11.126819 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-a6cf8e83-8e5b-4a9b-9a13-a07a4a8b4d1b req-ab8c244b-db7a-4483-8d97-503956c5af4d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043556 Jul 28 04:03:11.130343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 291/565] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:11.424427 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c3cc378f-e497-4410-a42e-e302db15347f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:11.425235 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c3cc378f-e497-4410-a42e-e302db15347f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:11.433314 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c3cc378f-e497-4410-a42e-e302db15347f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:11.433767 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c3cc378f-e497-4410-a42e-e302db15347f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:11.434616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c3cc378f-e497-4410-a42e-e302db15347f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:11.435060 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c3cc378f-e497-4410-a42e-e302db15347f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:11.438257 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:11.769123 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c3cc378f-e497-4410-a42e-e302db15347f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:11.782108 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c3cc378f-e497-4410-a42e-e302db15347f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.361820 Jul 28 04:03:11.783117 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 275/566] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:11 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:12.402800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bb2d1355-c8a4-4280-b588-9dcccbccc998 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:12.403826 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-bb2d1355-c8a4-4280-b588-9dcccbccc998 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:12.416463 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bb2d1355-c8a4-4280-b588-9dcccbccc998 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:12.417168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bb2d1355-c8a4-4280-b588-9dcccbccc998 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:12.419000 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bb2d1355-c8a4-4280-b588-9dcccbccc998 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:12.420038 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bb2d1355-c8a4-4280-b588-9dcccbccc998 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:12.480926 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-bb2d1355-c8a4-4280-b588-9dcccbccc998 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments/be47d93a-6d2d-4343-805a-0e81adf44856" status: 200 len: 194 microversion: 2.20 time: 0.090768 Jul 28 04:03:12.482354 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 292/567] 10.222.0.66 () {60 vars in 1454 bytes} [Thu Jul 28 04:03:12 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments/be47d93a-6d2d-4343-805a-0e81adf44856 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:03:12.588490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c50120b0-4494-427b-94e2-ac50d3ada867 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:12.590067 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c50120b0-4494-427b-94e2-ac50d3ada867 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:12.604236 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c50120b0-4494-427b-94e2-ac50d3ada867 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:12.605527 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c50120b0-4494-427b-94e2-ac50d3ada867 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:12.606930 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c50120b0-4494-427b-94e2-ac50d3ada867 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:12.607636 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c50120b0-4494-427b-94e2-ac50d3ada867 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:12.720685 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-c50120b0-4494-427b-94e2-ac50d3ada867 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lazy-loading 'services' on Instance uuid 4eadfe50-2ab9-46dc-be42-b9496e4008ac {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:12.812294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-44ef0427-3cac-400c-b08e-5fc4597807bb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:12.813282 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-44ef0427-3cac-400c-b08e-5fc4597807bb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:12.821198 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44ef0427-3cac-400c-b08e-5fc4597807bb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:12.822671 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44ef0427-3cac-400c-b08e-5fc4597807bb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:12.823719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44ef0427-3cac-400c-b08e-5fc4597807bb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:12.824489 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-44ef0427-3cac-400c-b08e-5fc4597807bb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:12.980571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-44ef0427-3cac-400c-b08e-5fc4597807bb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:12.989922 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-44ef0427-3cac-400c-b08e-5fc4597807bb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.181966 Jul 28 04:03:12.991265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 293/568] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:12 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:13.052103 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c50120b0-4494-427b-94e2-ac50d3ada867 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments/be47d93a-6d2d-4343-805a-0e81adf44856" status: 202 len: 0 microversion: 2.20 time: 0.476460 Jul 28 04:03:13.053318 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 276/569] 10.222.0.66 () {60 vars in 1457 bytes} [Thu Jul 28 04:03:12 2022] DELETE /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments/be47d93a-6d2d-4343-805a-0e81adf44856 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:03:13.081769 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0919b2c3-92ca-4e81-8adc-6c75510858a5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:13.087829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0919b2c3-92ca-4e81-8adc-6c75510858a5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:13.096437 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0919b2c3-92ca-4e81-8adc-6c75510858a5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:13.097179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0919b2c3-92ca-4e81-8adc-6c75510858a5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:13.098839 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0919b2c3-92ca-4e81-8adc-6c75510858a5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:13.099422 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0919b2c3-92ca-4e81-8adc-6c75510858a5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:13.140231 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0919b2c3-92ca-4e81-8adc-6c75510858a5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073484 Jul 28 04:03:13.140943 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 294/570] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Jul 28 04:03:13 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:03:13.364428 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-4da6b108-06c5-43c5-a99a-01fb1128f699 req-b76b1dbd-0001-4801-b99a-2a81a576b33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04979300-ed48-49df-85a4-13db2fae199b", "tag": "f5b15cf1-c323-439c-8cf9-2d761c12404a"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:13.381357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-4da6b108-06c5-43c5-a99a-01fb1128f699 req-b76b1dbd-0001-4801-b99a-2a81a576b33c service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:13.382307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-4da6b108-06c5-43c5-a99a-01fb1128f699 req-b76b1dbd-0001-4801-b99a-2a81a576b33c service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:13.404894 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-4da6b108-06c5-43c5-a99a-01fb1128f699 req-b76b1dbd-0001-4801-b99a-2a81a576b33c service nova] Creating event network-changed:f5b15cf1-c323-439c-8cf9-2d761c12404a for instance 04979300-ed48-49df-85a4-13db2fae199b on hv-cinder-85127 Jul 28 04:03:13.413617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-4da6b108-06c5-43c5-a99a-01fb1128f699 req-b76b1dbd-0001-4801-b99a-2a81a576b33c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058467 Jul 28 04:03:13.414666 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 277/571] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:03:14.013806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-60d7defb-89a3-43e6-a16d-009342b7fc1a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:14.014465 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-60d7defb-89a3-43e6-a16d-009342b7fc1a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:14.021635 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-60d7defb-89a3-43e6-a16d-009342b7fc1a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:14.022089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-60d7defb-89a3-43e6-a16d-009342b7fc1a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:14.022937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-60d7defb-89a3-43e6-a16d-009342b7fc1a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:14.023383 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-60d7defb-89a3-43e6-a16d-009342b7fc1a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:14.156892 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d2630857-428c-4613-8384-f6f1eb4cf4c2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:14.159240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d2630857-428c-4613-8384-f6f1eb4cf4c2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:14.166375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d2630857-428c-4613-8384-f6f1eb4cf4c2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:14.166837 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d2630857-428c-4613-8384-f6f1eb4cf4c2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:14.167680 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d2630857-428c-4613-8384-f6f1eb4cf4c2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:14.168193 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d2630857-428c-4613-8384-f6f1eb4cf4c2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:14.195813 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-60d7defb-89a3-43e6-a16d-009342b7fc1a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:14.202165 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d2630857-428c-4613-8384-f6f1eb4cf4c2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052300 Jul 28 04:03:14.202957 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 278/572] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Jul 28 04:03:14 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:03:14.210265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-60d7defb-89a3-43e6-a16d-009342b7fc1a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.200691 Jul 28 04:03:14.211567 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 295/573] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:14 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:15.215766 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2a32e267-4773-4e41-850a-f29843221bc2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:15.218671 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2a32e267-4773-4e41-850a-f29843221bc2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:15.225846 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2a32e267-4773-4e41-850a-f29843221bc2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.226305 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2a32e267-4773-4e41-850a-f29843221bc2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.227099 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2a32e267-4773-4e41-850a-f29843221bc2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.227604 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2a32e267-4773-4e41-850a-f29843221bc2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.235422 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a7d11028-2014-487e-bab9-b31869be819a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:15.236999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a7d11028-2014-487e-bab9-b31869be819a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:15.244697 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a7d11028-2014-487e-bab9-b31869be819a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.245144 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a7d11028-2014-487e-bab9-b31869be819a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.247138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a7d11028-2014-487e-bab9-b31869be819a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.247138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a7d11028-2014-487e-bab9-b31869be819a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.270235 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2a32e267-4773-4e41-850a-f29843221bc2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059146 Jul 28 04:03:15.271266 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 279/574] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Jul 28 04:03:15 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:15.350130 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-fcf9aa61-e5c8-41ef-985f-49562de05ecc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:15.350644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-fcf9aa61-e5c8-41ef-985f-49562de05ecc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:15.357545 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa61-e5c8-41ef-985f-49562de05ecc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.358015 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa61-e5c8-41ef-985f-49562de05ecc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.358829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa61-e5c8-41ef-985f-49562de05ecc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.359280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fcf9aa61-e5c8-41ef-985f-49562de05ecc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.405980 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-fcf9aa61-e5c8-41ef-985f-49562de05ecc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:03:15.426107 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a7d11028-2014-487e-bab9-b31869be819a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:15.429491 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a7d11028-2014-487e-bab9-b31869be819a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.198000 Jul 28 04:03:15.440598 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 296/575] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:15 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:15.783744 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-fcf9aa61-e5c8-41ef-985f-49562de05ecc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 204 len: 0 microversion: 2.20 time: 0.437652 Jul 28 04:03:15.784299 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 280/576] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Jul 28 04:03:15 2022] DELETE /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 04:03:15.794178 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:15.794802 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:15.802033 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.802481 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.803281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.803749 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.967169 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:15.979042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:15.980806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:15.982089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d2e4c513-84b4-4879-9303-2ca8c561d0d9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.193264 Jul 28 04:03:15.982662 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 297/577] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:15 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:16.458927 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0d86bca9-c424-4926-8bfd-fd69b8d026bd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:16.459684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0d86bca9-c424-4926-8bfd-fd69b8d026bd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:16.467498 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d86bca9-c424-4926-8bfd-fd69b8d026bd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:16.467969 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d86bca9-c424-4926-8bfd-fd69b8d026bd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:16.468777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d86bca9-c424-4926-8bfd-fd69b8d026bd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:16.469224 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d86bca9-c424-4926-8bfd-fd69b8d026bd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:16.622665 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0d86bca9-c424-4926-8bfd-fd69b8d026bd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:16.631355 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0d86bca9-c424-4926-8bfd-fd69b8d026bd tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.176682 Jul 28 04:03:16.632013 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 281/578] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:16 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:17.021572 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:17.022238 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:17.025859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:17.026770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=10 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:17.032296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:17.032763 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:17.033620 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:17.034146 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:17.189022 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:17.198698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:17.200491 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:17.201797 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-39f221ca-dbe9-4b04-95e1-ba547aaf1e7c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.184451 Jul 28 04:03:17.202432 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 298/579] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:17 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:17.659392 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-40f339fc-f9e3-4356-802a-a1edc78d707d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:17.660664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-40f339fc-f9e3-4356-802a-a1edc78d707d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:17.664192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:17.674933 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-40f339fc-f9e3-4356-802a-a1edc78d707d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:17.675778 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-40f339fc-f9e3-4356-802a-a1edc78d707d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:17.677262 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-40f339fc-f9e3-4356-802a-a1edc78d707d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:17.678208 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-40f339fc-f9e3-4356-802a-a1edc78d707d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:17.836900 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-40f339fc-f9e3-4356-802a-a1edc78d707d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:17.845735 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-40f339fc-f9e3-4356-802a-a1edc78d707d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.194512 Jul 28 04:03:17.849536 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 282/580] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:17 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:18.227189 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:18.228008 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:18.235006 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:18.235526 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:18.236407 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:18.236848 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:18.373370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:18.381832 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:18.383393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:18.385395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-aa8e43a4-e039-4bbc-b8d6-7bf543fb36ff tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.162565 Jul 28 04:03:18.385964 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 299/581] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:18 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:18.870333 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7776f438-3839-464a-bb1d-c2d743e180ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:18.871176 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7776f438-3839-464a-bb1d-c2d743e180ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:18.881073 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7776f438-3839-464a-bb1d-c2d743e180ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:18.885627 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7776f438-3839-464a-bb1d-c2d743e180ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:18.885627 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7776f438-3839-464a-bb1d-c2d743e180ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:18.885627 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7776f438-3839-464a-bb1d-c2d743e180ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:19.112574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7776f438-3839-464a-bb1d-c2d743e180ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:19.127311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7776f438-3839-464a-bb1d-c2d743e180ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.260077 Jul 28 04:03:19.127311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 283/582] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:18 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:19.408806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:19.409541 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:19.416680 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:19.417151 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:19.417968 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:19.418416 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:19.580324 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:19.591292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:19.593037 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:19.594274 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ce5dae20-f271-45ad-9b0e-7f08354ce848 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1724 microversion: 2.20 time: 0.189686 Jul 28 04:03:19.594868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 300/583] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:19 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:19.850157 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-055a0875-f10b-442a-88a2-c2fa3e4065f0 req-216be4ae-2193-4c88-b00d-ec85d7d06035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04979300-ed48-49df-85a4-13db2fae199b", "name": "network-vif-plugged", "status": "completed", "tag": "f5b15cf1-c323-439c-8cf9-2d761c12404a"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:19.869139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-055a0875-f10b-442a-88a2-c2fa3e4065f0 req-216be4ae-2193-4c88-b00d-ec85d7d06035 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:19.869139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-055a0875-f10b-442a-88a2-c2fa3e4065f0 req-216be4ae-2193-4c88-b00d-ec85d7d06035 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:19.890764 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-055a0875-f10b-442a-88a2-c2fa3e4065f0 req-216be4ae-2193-4c88-b00d-ec85d7d06035 service nova] Creating event network-vif-plugged:f5b15cf1-c323-439c-8cf9-2d761c12404a for instance 04979300-ed48-49df-85a4-13db2fae199b on hv-cinder-85127 Jul 28 04:03:19.900354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-055a0875-f10b-442a-88a2-c2fa3e4065f0 req-216be4ae-2193-4c88-b00d-ec85d7d06035 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056108 Jul 28 04:03:19.901448 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 284/584] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:20.144372 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-8f4ef967-b415-4b35-9abc-ac4db4f91c96 req-9be084c2-6a06-48e5-96aa-768d26abbebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eadfe50-2ab9-46dc-be42-b9496e4008ac", "name": "network-vif-deleted", "tag": "ef1e8289-929e-424e-b1c1-98a45ed868ea"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:20.154974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-8f4ef967-b415-4b35-9abc-ac4db4f91c96 req-9be084c2-6a06-48e5-96aa-768d26abbebc service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.155444 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-8f4ef967-b415-4b35-9abc-ac4db4f91c96 req-9be084c2-6a06-48e5-96aa-768d26abbebc service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:20.160404 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-65370fcb-f70e-4160-9c18-daf7eb5dba19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:20.161410 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-65370fcb-f70e-4160-9c18-daf7eb5dba19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:20.171129 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-8f4ef967-b415-4b35-9abc-ac4db4f91c96 req-9be084c2-6a06-48e5-96aa-768d26abbebc service nova] Creating event network-vif-deleted:ef1e8289-929e-424e-b1c1-98a45ed868ea for instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac on hv-cinder-85127 Jul 28 04:03:20.179801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-8f4ef967-b415-4b35-9abc-ac4db4f91c96 req-9be084c2-6a06-48e5-96aa-768d26abbebc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040390 Jul 28 04:03:20.183634 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65370fcb-f70e-4160-9c18-daf7eb5dba19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.184114 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65370fcb-f70e-4160-9c18-daf7eb5dba19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:20.185604 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65370fcb-f70e-4160-9c18-daf7eb5dba19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.186793 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-65370fcb-f70e-4160-9c18-daf7eb5dba19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:20.188078 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 301/585] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:03:20.387400 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-65370fcb-f70e-4160-9c18-daf7eb5dba19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:20.414158 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-65370fcb-f70e-4160-9c18-daf7eb5dba19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.261108 Jul 28 04:03:20.415560 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 285/586] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:20 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:20.637569 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:20.638378 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:20.645390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.645855 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:20.646624 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.647072 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:20.682692 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.683150 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:20.683605 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lazy-loading 'fault' on Instance uuid 4eadfe50-2ab9-46dc-be42-b9496e4008ac {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:20.755504 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:20.768440 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:20.771702 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:20.773994 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4e0d6a3e-a1c6-41f9-a793-91260ca9f9f6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1372 microversion: 2.20 time: 0.142283 Jul 28 04:03:20.775840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 302/587] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:20 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:21.440141 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ea07b22f-94c2-4899-9df0-44203a0368b0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:21.440762 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ea07b22f-94c2-4899-9df0-44203a0368b0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:21.448264 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea07b22f-94c2-4899-9df0-44203a0368b0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.448723 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea07b22f-94c2-4899-9df0-44203a0368b0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:21.449500 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea07b22f-94c2-4899-9df0-44203a0368b0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.449945 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ea07b22f-94c2-4899-9df0-44203a0368b0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:21.590853 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ea07b22f-94c2-4899-9df0-44203a0368b0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:21.598873 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ea07b22f-94c2-4899-9df0-44203a0368b0 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.162570 Jul 28 04:03:21.599473 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 286/588] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:21 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:21.814175 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:21.815000 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:21.823671 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.824316 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:21.825187 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.825642 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:21.867333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.867783 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:21.868883 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lazy-loading 'fault' on Instance uuid 4eadfe50-2ab9-46dc-be42-b9496e4008ac {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:21.919636 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:21.928381 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:21.929929 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:21.931706 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7e3306df-7046-4c58-af1f-d98b715bebdb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1372 microversion: 2.20 time: 0.121795 Jul 28 04:03:21.936441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 303/589] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:21 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:22.621835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e181dde2-d76f-44bd-afda-31c4b9abfda6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:22.622450 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e181dde2-d76f-44bd-afda-31c4b9abfda6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:22.628786 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e181dde2-d76f-44bd-afda-31c4b9abfda6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:22.629246 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e181dde2-d76f-44bd-afda-31c4b9abfda6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:22.630224 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e181dde2-d76f-44bd-afda-31c4b9abfda6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:22.630463 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e181dde2-d76f-44bd-afda-31c4b9abfda6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:22.764631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e181dde2-d76f-44bd-afda-31c4b9abfda6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:22.772516 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e181dde2-d76f-44bd-afda-31c4b9abfda6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.155182 Jul 28 04:03:22.773106 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 287/590] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:22 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:22.958885 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:22.959549 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:22.962168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:22.968460 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:22.968941 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:22.969734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:22.970187 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:23.007408 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:23.007863 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:23.008359 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lazy-loading 'fault' on Instance uuid 4eadfe50-2ab9-46dc-be42-b9496e4008ac {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:23.052364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:23.061888 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:23.063428 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:23.064651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6348019c-c0c4-4a5d-83d1-6962d8682209 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1372 microversion: 2.20 time: 0.109668 Jul 28 04:03:23.065211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 304/591] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:22 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:23.793975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9826bc58-1c1c-424a-836c-402014c13569 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:23.794561 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9826bc58-1c1c-424a-836c-402014c13569 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:23.801497 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9826bc58-1c1c-424a-836c-402014c13569 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:23.801981 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9826bc58-1c1c-424a-836c-402014c13569 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:23.802810 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9826bc58-1c1c-424a-836c-402014c13569 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:23.803287 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9826bc58-1c1c-424a-836c-402014c13569 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:23.955767 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9826bc58-1c1c-424a-836c-402014c13569 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:23.963700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9826bc58-1c1c-424a-836c-402014c13569 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.174264 Jul 28 04:03:23.964334 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 288/592] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:23 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:24.091245 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:24.091865 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:24.098693 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.099144 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.099932 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.100402 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.132950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.133405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.133998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lazy-loading 'fault' on Instance uuid 4eadfe50-2ab9-46dc-be42-b9496e4008ac {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:24.178089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:24.187150 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:24.188801 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:24.190006 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-cd917138-6236-4f96-ad33-1d8f21311f29 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 200 len: 1372 microversion: 2.20 time: 0.103541 Jul 28 04:03:24.190570 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 305/593] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:24 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:24.724287 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-efad3517-9e71-4acd-b40c-86154dab205c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:24.724835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-efad3517-9e71-4acd-b40c-86154dab205c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:24.733686 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-efad3517-9e71-4acd-b40c-86154dab205c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.734965 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-efad3517-9e71-4acd-b40c-86154dab205c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.737279 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-efad3517-9e71-4acd-b40c-86154dab205c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.737279 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-efad3517-9e71-4acd-b40c-86154dab205c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.762300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-efad3517-9e71-4acd-b40c-86154dab205c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lazy-loading 'flavor' on Instance uuid 1ed19419-f0b9-473d-93cb-fefb8c29d74e {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:24.868964 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:24.986577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-23d58365-4e8d-4800-b27f-6811e28b9a94 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:24.987258 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-23d58365-4e8d-4800-b27f-6811e28b9a94 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:24.995270 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-23d58365-4e8d-4800-b27f-6811e28b9a94 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.995873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-23d58365-4e8d-4800-b27f-6811e28b9a94 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.996995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-23d58365-4e8d-4800-b27f-6811e28b9a94 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.997573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-23d58365-4e8d-4800-b27f-6811e28b9a94 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.163769 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-23d58365-4e8d-4800-b27f-6811e28b9a94 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:25.164844 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-efad3517-9e71-4acd-b40c-86154dab205c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "POST /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e/action" status: 202 len: 0 microversion: 2.1 time: 0.444187 Jul 28 04:03:25.165827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 289/594] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:03:24 2022] POST /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:03:25.173430 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-23d58365-4e8d-4800-b27f-6811e28b9a94 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1367 microversion: 2.1 time: 0.192071 Jul 28 04:03:25.174019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 306/595] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:24 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:25.181286 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-fb749695-b407-4654-acbb-803505c182f2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:25.182343 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-fb749695-b407-4654-acbb-803505c182f2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:25.190279 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fb749695-b407-4654-acbb-803505c182f2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.190733 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fb749695-b407-4654-acbb-803505c182f2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.191531 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fb749695-b407-4654-acbb-803505c182f2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.191991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fb749695-b407-4654-acbb-803505c182f2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.223772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:25.225007 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:25.235114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.235940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.237339 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.238040 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.266424 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] HTTP exception thrown: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Request method failure captured: Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac HTTP/1.1 Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmF81-maHFWXAa0eF722ZJ-NN0Di0z-iuOcncK5PmXpwTFYQ99YRfOEWhqOxCFkWe9zge9d2PMeoHDMfSH8ylZyxSThi6MAdtSkff6g2eK2qi7qIUAKbEdxsG4YqH1ATB_JxpF-7K0xaTBV4F7Msy9r0bL4SOdKzn3XwnukRnNzTO8 Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:03:25.269328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52b087e8dc5c4426b8402dfdf99328ad", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}] Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: cf3333bf3bc149139f9f6b4e89d2e89b Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:03:25.271664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '4eadfe50-2ab9-46dc-be42-b9496e4008ac'} Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:25.272454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:03:25.273649 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:03:25.275553 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Returning 404 to user: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:25.275553 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-76dc627b-436e-4a58-a704-473797ecf892 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 404 len: 111 microversion: 2.20 time: 0.060296 Jul 28 04:03:25.275553 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 307/596] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:25 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 04:03:25.287218 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4892143a-e03f-4b6a-8ed9-c5e2bf9ddb37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '.version_select at 0x7f5572e8a1f0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:25.353923 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-fb749695-b407-4654-acbb-803505c182f2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:25.363718 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-fb749695-b407-4654-acbb-803505c182f2 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.187819 Jul 28 04:03:25.364955 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 290/597] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:25 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:25.388599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4892143a-e03f-4b6a-8ed9-c5e2bf9ddb37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586234179" status: 204 len: 0 microversion: 2.20 time: 0.110895 Jul 28 04:03:25.389395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 308/598] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Jul 28 04:03:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586234179 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 04:03:26.197539 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ecd499ee-cf93-4cd4-8935-a3f9d3b81e0e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:26.198277 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ecd499ee-cf93-4cd4-8935-a3f9d3b81e0e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:26.205485 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ecd499ee-cf93-4cd4-8935-a3f9d3b81e0e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.214312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ecd499ee-cf93-4cd4-8935-a3f9d3b81e0e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.214312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ecd499ee-cf93-4cd4-8935-a3f9d3b81e0e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.214312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ecd499ee-cf93-4cd4-8935-a3f9d3b81e0e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.390122 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2449ec56-8e37-4232-9e81-e7ee86bf593a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:26.390753 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2449ec56-8e37-4232-9e81-e7ee86bf593a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:26.395236 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ecd499ee-cf93-4cd4-8935-a3f9d3b81e0e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:26.398147 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2449ec56-8e37-4232-9e81-e7ee86bf593a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.398611 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2449ec56-8e37-4232-9e81-e7ee86bf593a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.399512 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2449ec56-8e37-4232-9e81-e7ee86bf593a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.400180 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2449ec56-8e37-4232-9e81-e7ee86bf593a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.404999 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ecd499ee-cf93-4cd4-8935-a3f9d3b81e0e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1557 microversion: 2.1 time: 0.211829 Jul 28 04:03:26.405599 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 291/599] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:26 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:26.411063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7765a5e8-d6d6-4d8e-adbb-0662957b7481 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'create', calling method: .version_select at 0x7f5572e1fa60>, body: {"keypair": {"name": "tempest-keypair-1843774019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbOUDWNLqnSEBKzirHGgp1kvdqoxH+GGhb5V8sRSiYRQ06gumGXWOVfxwnLEBGduSk5szgTrB5PD8XPFx4CZbrdJCP2+GoxPG+sIcVfIjpzk23hhYFLgeM9aQ0bcigNPw=="}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:26.428060 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-7765a5e8-d6d6-4d8e-adbb-0662957b7481 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Getting quotas for project 52b087e8dc5c4426b8402dfdf99328ad. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:26.433118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-7765a5e8-d6d6-4d8e-adbb-0662957b7481 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Getting quotas for user cf3333bf3bc149139f9f6b4e89d2e89b and project 52b087e8dc5c4426b8402dfdf99328ad. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:26.435791 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=100 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:26.562056 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2449ec56-8e37-4232-9e81-e7ee86bf593a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:26.572503 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2449ec56-8e37-4232-9e81-e7ee86bf593a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.185971 Jul 28 04:03:26.579120 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 309/600] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:26 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:26.579501 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b50c41b2-6c77-4a0e-91a0-4812bdc6c9c9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:26.580335 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b50c41b2-6c77-4a0e-91a0-4812bdc6c9c9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:26.587388 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b50c41b2-6c77-4a0e-91a0-4812bdc6c9c9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.587388 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b50c41b2-6c77-4a0e-91a0-4812bdc6c9c9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.588415 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b50c41b2-6c77-4a0e-91a0-4812bdc6c9c9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.588871 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b50c41b2-6c77-4a0e-91a0-4812bdc6c9c9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.607922 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7765a5e8-d6d6-4d8e-adbb-0662957b7481 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.200906 Jul 28 04:03:26.614438 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 292/601] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Jul 28 04:03:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 202 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 04:03:26.676215 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b50c41b2-6c77-4a0e-91a0-4812bdc6c9c9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101930 Jul 28 04:03:26.676808 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 310/602] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Jul 28 04:03:26 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:27.594465 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5ce1b15c-d01e-4b3d-8b85-771451c50d5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:27.595096 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5ce1b15c-d01e-4b3d-8b85-771451c50d5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:27.602048 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5ce1b15c-d01e-4b3d-8b85-771451c50d5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.603046 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5ce1b15c-d01e-4b3d-8b85-771451c50d5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.603849 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5ce1b15c-d01e-4b3d-8b85-771451c50d5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.604496 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5ce1b15c-d01e-4b3d-8b85-771451c50d5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.795039 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5ce1b15c-d01e-4b3d-8b85-771451c50d5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:27.803168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5ce1b15c-d01e-4b3d-8b85-771451c50d5a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.212882 Jul 28 04:03:27.803839 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 293/603] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:27 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:27.931102 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-afa6839f-b340-4568-b22d-a7c7aa4df7d3 req-6f366237-2f3d-4eb3-948e-566f09c642bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04979300-ed48-49df-85a4-13db2fae199b", "tag": "f5b15cf1-c323-439c-8cf9-2d761c12404a"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:27.948992 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-afa6839f-b340-4568-b22d-a7c7aa4df7d3 req-6f366237-2f3d-4eb3-948e-566f09c642bb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.948992 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-afa6839f-b340-4568-b22d-a7c7aa4df7d3 req-6f366237-2f3d-4eb3-948e-566f09c642bb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.962721 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-afa6839f-b340-4568-b22d-a7c7aa4df7d3 req-6f366237-2f3d-4eb3-948e-566f09c642bb service nova] Creating event network-changed:f5b15cf1-c323-439c-8cf9-2d761c12404a for instance 04979300-ed48-49df-85a4-13db2fae199b on hv-cinder-85127 Jul 28 04:03:27.968404 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-afa6839f-b340-4568-b22d-a7c7aa4df7d3 req-6f366237-2f3d-4eb3-948e-566f09c642bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043379 Jul 28 04:03:27.969023 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 311/604] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:03:28.434777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-418fad21-f1f6-41f3-be66-3281526668e1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:28.438520 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-418fad21-f1f6-41f3-be66-3281526668e1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:28.449628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-418fad21-f1f6-41f3-be66-3281526668e1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:28.450725 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-418fad21-f1f6-41f3-be66-3281526668e1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:28.451692 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-418fad21-f1f6-41f3-be66-3281526668e1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:28.452300 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-418fad21-f1f6-41f3-be66-3281526668e1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:28.502050 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-418fad21-f1f6-41f3-be66-3281526668e1 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074996 Jul 28 04:03:28.508148 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 294/605] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:03:28 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:03:28.591154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4febb384-b4d3-4ec9-ba57-121fc7e9b8ff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:28.591836 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4febb384-b4d3-4ec9-ba57-121fc7e9b8ff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:28.599066 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4febb384-b4d3-4ec9-ba57-121fc7e9b8ff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:28.599843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4febb384-b4d3-4ec9-ba57-121fc7e9b8ff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:28.600701 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4febb384-b4d3-4ec9-ba57-121fc7e9b8ff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:28.601154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4febb384-b4d3-4ec9-ba57-121fc7e9b8ff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:28.639047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4febb384-b4d3-4ec9-ba57-121fc7e9b8ff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:03:28.832538 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-05928e2f-47b2-4c07-856f-7384daadfa4f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:28.833492 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-05928e2f-47b2-4c07-856f-7384daadfa4f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:28.841414 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05928e2f-47b2-4c07-856f-7384daadfa4f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:28.842035 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05928e2f-47b2-4c07-856f-7384daadfa4f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:28.843155 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05928e2f-47b2-4c07-856f-7384daadfa4f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:28.843602 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-05928e2f-47b2-4c07-856f-7384daadfa4f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:28.996889 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4febb384-b4d3-4ec9-ba57-121fc7e9b8ff tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "DELETE /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 204 len: 0 microversion: 2.1 time: 0.411401 Jul 28 04:03:29.003610 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 312/606] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:03:28 2022] DELETE /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:03:29.017720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-88b800f6-3732-450b-9fdf-91c4fd4c928a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:29.018746 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-88b800f6-3732-450b-9fdf-91c4fd4c928a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:29.029835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-88b800f6-3732-450b-9fdf-91c4fd4c928a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:29.031097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-88b800f6-3732-450b-9fdf-91c4fd4c928a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:29.035197 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-88b800f6-3732-450b-9fdf-91c4fd4c928a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:29.035197 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-88b800f6-3732-450b-9fdf-91c4fd4c928a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:29.269381 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-88b800f6-3732-450b-9fdf-91c4fd4c928a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:29.270599 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-05928e2f-47b2-4c07-856f-7384daadfa4f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:29.279512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-05928e2f-47b2-4c07-856f-7384daadfa4f tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.451045 Jul 28 04:03:29.279900 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-88b800f6-3732-450b-9fdf-91c4fd4c928a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1674 microversion: 2.1 time: 0.272643 Jul 28 04:03:29.280847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 313/607] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:29 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1674 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:29.292188 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 295/608] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:28 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:30.175414 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1469908854", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "500d2409-0505-4e71-ad33-d33fa2f8a8dc"}], "security_groups": [{"name": "tempest-securitygroup--1230771757"}], "key_name": "tempest-keypair-1843774019", "user_data": "}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:30.304818 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-fdb29212-7a6b-4a22-aabd-6851185b06ef tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:30.305582 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-fdb29212-7a6b-4a22-aabd-6851185b06ef tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:30.305763 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] validate_networks() for [('500d2409-0505-4e71-ad33-d33fa2f8a8dc', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:03:30.316603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fdb29212-7a6b-4a22-aabd-6851185b06ef tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.317402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fdb29212-7a6b-4a22-aabd-6851185b06ef tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.318563 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fdb29212-7a6b-4a22-aabd-6851185b06ef tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.319352 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fdb29212-7a6b-4a22-aabd-6851185b06ef tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.482873 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-fdb29212-7a6b-4a22-aabd-6851185b06ef tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:30.497505 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-fdb29212-7a6b-4a22-aabd-6851185b06ef tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1674 microversion: 2.1 time: 0.198462 Jul 28 04:03:30.508828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 296/609] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:30 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:30.515503 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-893cc734-fc3d-4c4e-a11d-e7b186c6f432 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:30.516671 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-893cc734-fc3d-4c4e-a11d-e7b186c6f432 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:30.528478 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-893cc734-fc3d-4c4e-a11d-e7b186c6f432 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.529315 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-893cc734-fc3d-4c4e-a11d-e7b186c6f432 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.530742 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-893cc734-fc3d-4c4e-a11d-e7b186c6f432 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.531636 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-893cc734-fc3d-4c4e-a11d-e7b186c6f432 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.754908 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-893cc734-fc3d-4c4e-a11d-e7b186c6f432 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:30.763547 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-893cc734-fc3d-4c4e-a11d-e7b186c6f432 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.262608 Jul 28 04:03:30.764163 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 297/610] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:30 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:30.788882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:03:30.789314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:03:30.789819 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:03:30.790272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:03:30.790884 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:03:30.800535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.800993 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.801802 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.802243 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.820641 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Getting quotas for project 52b087e8dc5c4426b8402dfdf99328ad. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:30.825970 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Getting quotas for user cf3333bf3bc149139f9f6b4e89d2e89b and project 52b087e8dc5c4426b8402dfdf99328ad. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:30.838629 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:03:30.840970 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:03:30.988210 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-495f39d2-e785-47b5-a228-86f29df12433 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.817558 Jul 28 04:03:30.988899 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 314/611] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Jul 28 04:03:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 04:03:31.001835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a0b2654d-1361-455a-8acd-cd859f9793dd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:31.003385 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a0b2654d-1361-455a-8acd-cd859f9793dd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:31.083838 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a0b2654d-1361-455a-8acd-cd859f9793dd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:31.102129 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a0b2654d-1361-455a-8acd-cd859f9793dd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:31.106028 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a0b2654d-1361-455a-8acd-cd859f9793dd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:31.108235 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a0b2654d-1361-455a-8acd-cd859f9793dd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1282 microversion: 2.20 time: 0.110445 Jul 28 04:03:31.110307 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 298/612] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:30 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:31.521748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-782729ae-7cf7-45d0-9274-77c4abec1bd5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:31.522550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-782729ae-7cf7-45d0-9274-77c4abec1bd5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:31.531857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-782729ae-7cf7-45d0-9274-77c4abec1bd5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:31.531857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-782729ae-7cf7-45d0-9274-77c4abec1bd5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:31.532317 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-782729ae-7cf7-45d0-9274-77c4abec1bd5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:31.532480 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-782729ae-7cf7-45d0-9274-77c4abec1bd5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:31.722012 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-782729ae-7cf7-45d0-9274-77c4abec1bd5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:31.730617 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-782729ae-7cf7-45d0-9274-77c4abec1bd5 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1674 microversion: 2.1 time: 0.212633 Jul 28 04:03:31.731152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 315/613] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:31 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:31.785874 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-12c78ae9-871f-4234-8934-76577fb5a6b6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:31.786521 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-12c78ae9-871f-4234-8934-76577fb5a6b6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:31.795215 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12c78ae9-871f-4234-8934-76577fb5a6b6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:31.795673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12c78ae9-871f-4234-8934-76577fb5a6b6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:31.796509 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12c78ae9-871f-4234-8934-76577fb5a6b6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:31.796964 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-12c78ae9-871f-4234-8934-76577fb5a6b6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.095611 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-12c78ae9-871f-4234-8934-76577fb5a6b6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:32.111380 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-12c78ae9-871f-4234-8934-76577fb5a6b6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.329049 Jul 28 04:03:32.112497 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 299/614] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:31 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:32.150624 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:32.151536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:32.159065 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:32.159640 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.160790 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:32.161414 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.246697 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:32.264356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:32.267726 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:32.269973 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d0803ca9-446a-4b54-a6a4-ba09b4f80b8d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1286 microversion: 2.20 time: 0.124772 Jul 28 04:03:32.271093 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 316/615] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:32 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:32.725591 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-1c93adee-8baf-492d-b2aa-ce8faebbf9a0 req-d8d50644-ff34-4dce-8909-337789a8a1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69722c89-ea87-415c-8a3c-b10f0bff6b9e", "name": "network-vif-deleted", "tag": "be05219a-2802-4e35-ad33-836ad2f1d343"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:32.759701 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4b04292d-73f2-4539-af8a-3881958a8eac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:32.760998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4b04292d-73f2-4539-af8a-3881958a8eac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:32.764500 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-1c93adee-8baf-492d-b2aa-ce8faebbf9a0 req-d8d50644-ff34-4dce-8909-337789a8a1db service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:32.769254 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-1c93adee-8baf-492d-b2aa-ce8faebbf9a0 req-d8d50644-ff34-4dce-8909-337789a8a1db service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.780213 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4b04292d-73f2-4539-af8a-3881958a8eac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:32.781590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4b04292d-73f2-4539-af8a-3881958a8eac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.783445 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4b04292d-73f2-4539-af8a-3881958a8eac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:32.784488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4b04292d-73f2-4539-af8a-3881958a8eac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.821852 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-1c93adee-8baf-492d-b2aa-ce8faebbf9a0 req-d8d50644-ff34-4dce-8909-337789a8a1db service nova] Creating event network-vif-deleted:be05219a-2802-4e35-ad33-836ad2f1d343 for instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e on hv-cinder-85127 Jul 28 04:03:32.844897 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-1c93adee-8baf-492d-b2aa-ce8faebbf9a0 req-d8d50644-ff34-4dce-8909-337789a8a1db service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121930 Jul 28 04:03:32.850655 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 300/616] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:32.950668 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4b04292d-73f2-4539-af8a-3881958a8eac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:32.964776 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4b04292d-73f2-4539-af8a-3881958a8eac tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1606 microversion: 2.1 time: 0.211739 Jul 28 04:03:32.968208 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 317/617] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:32 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1606 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:33.154294 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4d89e645-43b5-48e2-be21-0386366c6c88 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:33.155502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4d89e645-43b5-48e2-be21-0386366c6c88 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:33.164371 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4d89e645-43b5-48e2-be21-0386366c6c88 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.165061 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4d89e645-43b5-48e2-be21-0386366c6c88 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.166330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4d89e645-43b5-48e2-be21-0386366c6c88 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.167064 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4d89e645-43b5-48e2-be21-0386366c6c88 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.299845 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:33.300986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:33.319509 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.320235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.321217 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.324614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.398675 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4d89e645-43b5-48e2-be21-0386366c6c88 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:33.417183 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4d89e645-43b5-48e2-be21-0386366c6c88 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.261837 Jul 28 04:03:33.418618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 301/618] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:33 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:33.436282 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:33.450039 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:33.451696 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:33.452908 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0ce22bf6-be78-4a3d-833e-a284f7b9424e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1334 microversion: 2.20 time: 0.160299 Jul 28 04:03:33.453497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 318/619] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:33 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:34.001442 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:34.002688 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:34.012282 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.012902 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.013723 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.014177 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.059722 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.060223 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.060689 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lazy-loading 'fault' on Instance uuid 69722c89-ea87-415c-8a3c-b10f0bff6b9e {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:34.147391 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:34.158390 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-223b8c7b-2d25-4a76-907b-75c4caf41faf tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 200 len: 1328 microversion: 2.1 time: 0.163309 Jul 28 04:03:34.159437 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 302/620] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:33 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 1328 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:34.442353 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-71999f32-c42f-4c86-a17f-eaf9a0aacda0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:34.442987 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-71999f32-c42f-4c86-a17f-eaf9a0aacda0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:34.451281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-71999f32-c42f-4c86-a17f-eaf9a0aacda0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.451748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-71999f32-c42f-4c86-a17f-eaf9a0aacda0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.455294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-71999f32-c42f-4c86-a17f-eaf9a0aacda0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.455294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-71999f32-c42f-4c86-a17f-eaf9a0aacda0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.481482 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:34.482596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:34.489387 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.490141 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.492028 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.492830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.620583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:34.620816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-71999f32-c42f-4c86-a17f-eaf9a0aacda0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:34.630414 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:34.632383 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:34.632757 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-71999f32-c42f-4c86-a17f-eaf9a0aacda0 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.194223 Jul 28 04:03:34.634577 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e93604bb-c88d-496d-8db3-bbd0d0a20418 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1340 microversion: 2.20 time: 0.159504 Jul 28 04:03:34.635650 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 303/621] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:34 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1340 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:34.638033 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 319/622] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:34 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:35.184903 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:35.192400 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:35.193291 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.193831 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.194708 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.195235 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.225664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] HTTP exception thrown: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Request method failure captured: Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e HTTP/1.1 Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gl_PM82xQgI6yZLI0aabg0s_CtUzE5TczQ-7KoZjaRn90NY40c-VQaXkVJora5SjgKxsVLO35UUfZ5WW3T65hzKnVGT8GbjlAESmHVtyLMdaAc2c-jv-VNZjhUaadgGN9PVGPefcJyIydX6NLbH9IGAL_wuHgqaJmaEjO_p1NNTYQU Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:03:35.233574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6a869e1e00fc4d8d9d4511e34501665f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}] Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: f301573dbb914d7a948851cb060d8483 Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:03:35.236464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '69722c89-ea87-415c-8a3c-b10f0bff6b9e'} Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:35.237976 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:03:35.245827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:03:35.248852 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Returning 404 to user: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:35.248852 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b60913a4-06d5-4d7d-b67e-7c41ab471254 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 404 len: 111 microversion: 2.1 time: 0.054572 Jul 28 04:03:35.248852 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 304/623] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:35 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:03:35.255047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2e77e1e0-119d-4a4a-ab6a-4236e87fab31 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '.version_select at 0x7f5572e5c0d0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:35.383058 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2e77e1e0-119d-4a4a-ab6a-4236e87fab31 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670813683" status: 202 len: 0 microversion: 2.1 time: 0.139881 Jul 28 04:03:35.384352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 320/624] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Jul 28 04:03:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670813683 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:03:35.674108 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-126bcb3a-514a-41da-abaf-e4213184dd85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:35.677023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:35.677392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-126bcb3a-514a-41da-abaf-e4213184dd85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:35.678382 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:35.691145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-126bcb3a-514a-41da-abaf-e4213184dd85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.695063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-126bcb3a-514a-41da-abaf-e4213184dd85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.697880 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-126bcb3a-514a-41da-abaf-e4213184dd85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.699373 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-126bcb3a-514a-41da-abaf-e4213184dd85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.705018 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.705018 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.718520 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.719379 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:36.041197 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-126bcb3a-514a-41da-abaf-e4213184dd85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:36.052596 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-126bcb3a-514a-41da-abaf-e4213184dd85 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.387285 Jul 28 04:03:36.053964 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 321/625] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:35 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:36.392360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:36.409561 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:36.412962 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:36.415375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ed4dca74-919a-4229-976a-ee44f3a1e633 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.745643 Jul 28 04:03:36.433448 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 305/626] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:35 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:36.770106 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-2b414836-35db-4933-8e21-05317b16901b req-6096448a-aab7-45e8-880c-f5261a822333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29710033-f00f-435c-8485-9dd60d728f27", "tag": "de721302-c218-45d7-87a1-d79d5e51a7e4"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:36.784948 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-2b414836-35db-4933-8e21-05317b16901b req-6096448a-aab7-45e8-880c-f5261a822333 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:36.785432 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-2b414836-35db-4933-8e21-05317b16901b req-6096448a-aab7-45e8-880c-f5261a822333 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:36.833035 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-2b414836-35db-4933-8e21-05317b16901b req-6096448a-aab7-45e8-880c-f5261a822333 service nova] Creating event network-changed:de721302-c218-45d7-87a1-d79d5e51a7e4 for instance 29710033-f00f-435c-8485-9dd60d728f27 on hv-cinder-85127 Jul 28 04:03:36.864089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-2b414836-35db-4933-8e21-05317b16901b req-6096448a-aab7-45e8-880c-f5261a822333 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108802 Jul 28 04:03:36.864089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 322/627] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:37.089625 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f32cc70d-0a49-4f3a-b464-74c769238dc1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:37.091136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f32cc70d-0a49-4f3a-b464-74c769238dc1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:37.099836 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f32cc70d-0a49-4f3a-b464-74c769238dc1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.100669 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f32cc70d-0a49-4f3a-b464-74c769238dc1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.101484 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f32cc70d-0a49-4f3a-b464-74c769238dc1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.101949 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f32cc70d-0a49-4f3a-b464-74c769238dc1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.457996 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:37.458690 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:37.466195 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.466650 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.467443 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.467885 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.502462 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f32cc70d-0a49-4f3a-b464-74c769238dc1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:37.514731 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f32cc70d-0a49-4f3a-b464-74c769238dc1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.430078 Jul 28 04:03:37.516882 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 306/628] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:37 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:37.566717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7991d604-e706-4cb5-af94-f041f77a32ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'create', calling method: .version_select at 0x7f5572e81d30>, body: {"keypair": {"name": "tempest-keypair-572316035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARvEl5xnkbEgsLc5NgSJ+cgOP0oHAq0T6SWgTSSuc+Po8dUbeFIIaP+GJVmtVOgoIaSrEV2+IyPQVwnv9HuNr5DZIqokzn+6TwvIPxvWMNRH5WPP+3KCzssVAtHNCv06w=="}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:37.585801 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-7991d604-e706-4cb5-af94-f041f77a32ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Getting quotas for project 6a869e1e00fc4d8d9d4511e34501665f. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:37.591457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-7991d604-e706-4cb5-af94-f041f77a32ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Getting quotas for user f301573dbb914d7a948851cb060d8483 and project 6a869e1e00fc4d8d9d4511e34501665f. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:37.608910 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:37.691664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:37.701652 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:37.703170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:37.704369 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-55e88098-4e2c-4135-b201-4ab9cdf8b295 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.250665 Jul 28 04:03:37.704939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 323/629] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:37 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:03:37.712986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7991d604-e706-4cb5-af94-f041f77a32ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149935 Jul 28 04:03:37.713999 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 307/630] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 04:03:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:38.547443 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-dd000f1f-0d96-42f2-bd4b-5d980b5b7887 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:38.549575 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-dd000f1f-0d96-42f2-bd4b-5d980b5b7887 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:38.564374 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dd000f1f-0d96-42f2-bd4b-5d980b5b7887 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.565023 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dd000f1f-0d96-42f2-bd4b-5d980b5b7887 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.567342 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dd000f1f-0d96-42f2-bd4b-5d980b5b7887 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.568354 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-dd000f1f-0d96-42f2-bd4b-5d980b5b7887 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.749193 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:38.750048 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:38.757480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.757933 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.758768 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.759306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.771082 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-dd000f1f-0d96-42f2-bd4b-5d980b5b7887 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:38.786866 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-dd000f1f-0d96-42f2-bd4b-5d980b5b7887 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.247729 Jul 28 04:03:38.792071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 324/631] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:38 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:39.040243 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:39.062025 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:39.063608 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:39.064806 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-965aab39-28c5-49ed-ab7d-a09211ebc7d4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.320754 Jul 28 04:03:39.065368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 308/632] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:38 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:03:39.821104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7e24562c-880d-4276-ac81-c1a221c28461 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:39.821853 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7e24562c-880d-4276-ac81-c1a221c28461 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:39.829683 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e24562c-880d-4276-ac81-c1a221c28461 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:39.830147 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e24562c-880d-4276-ac81-c1a221c28461 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:39.830983 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e24562c-880d-4276-ac81-c1a221c28461 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:39.831435 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7e24562c-880d-4276-ac81-c1a221c28461 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.055027 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7e24562c-880d-4276-ac81-c1a221c28461 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:40.064138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7e24562c-880d-4276-ac81-c1a221c28461 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.246900 Jul 28 04:03:40.064612 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 325/633] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:39 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:40.089220 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:40.090457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:40.097351 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.097800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.098662 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.099100 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.115211 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:40.273152 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:40.281714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:40.283222 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:40.284398 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2199d258-c3f5-40ff-a446-993d75f931bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.199507 Jul 28 04:03:40.285160 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 309/634] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:40 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:40.850329 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1633562164", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b7076b1-5b54-41f8-8740-25deddb61b0a"}], "security_groups": [{"name": "tempest-securitygroup--459066907"}], "key_name": "tempest-keypair-572316035", "user_data": "}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:40.856070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:40.857209 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=6 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:40.982235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] validate_networks() for [('5b7076b1-5b54-41f8-8740-25deddb61b0a', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:03:41.088570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ed9cd97d-5749-4f35-93b8-02780567dc8a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:41.089465 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ed9cd97d-5749-4f35-93b8-02780567dc8a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:41.097474 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed9cd97d-5749-4f35-93b8-02780567dc8a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.097926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed9cd97d-5749-4f35-93b8-02780567dc8a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.098722 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed9cd97d-5749-4f35-93b8-02780567dc8a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.099167 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed9cd97d-5749-4f35-93b8-02780567dc8a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.259483 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ed9cd97d-5749-4f35-93b8-02780567dc8a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:41.274972 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ed9cd97d-5749-4f35-93b8-02780567dc8a tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1570 microversion: 2.1 time: 0.189506 Jul 28 04:03:41.276372 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 310/635] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:41 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:41.303301 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-467c0a51-0b86-423f-8393-9f16a3f55327 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:41.304821 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-467c0a51-0b86-423f-8393-9f16a3f55327 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:41.317213 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-467c0a51-0b86-423f-8393-9f16a3f55327 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.318010 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-467c0a51-0b86-423f-8393-9f16a3f55327 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.323681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-467c0a51-0b86-423f-8393-9f16a3f55327 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.323681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-467c0a51-0b86-423f-8393-9f16a3f55327 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.360965 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-467c0a51-0b86-423f-8393-9f16a3f55327 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=135704) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 04:03:41.703619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:03:41.705829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:03:41.706345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:03:41.706839 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:03:41.707598 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:03:41.719942 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.720497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.721298 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.721798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.740727 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Getting quotas for project 6a869e1e00fc4d8d9d4511e34501665f. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:41.745877 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Getting quotas for user f301573dbb914d7a948851cb060d8483 and project 6a869e1e00fc4d8d9d4511e34501665f. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:41.757748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:03:41.760155 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:03:41.794205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-467c0a51-0b86-423f-8393-9f16a3f55327 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "POST /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e/action" status: 202 len: 0 microversion: 2.1 time: 0.500062 Jul 28 04:03:41.795218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 311/636] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:03:41 2022] POST /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:03:41.799942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:41.800599 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:41.817447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.817447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.817447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.818488 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.983211 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:41.991966 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:41.994873 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:41.996311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b9c1d237-982e-489c-bed5-a98bd077194c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.200501 Jul 28 04:03:41.997103 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 312/637] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:41 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:42.001900 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-63025f2b-d4ba-49e7-b9ea-7773fc4335b8 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:42.004399 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-63025f2b-d4ba-49e7-b9ea-7773fc4335b8 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:42.014626 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-63025f2b-d4ba-49e7-b9ea-7773fc4335b8 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:42.015172 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-63025f2b-d4ba-49e7-b9ea-7773fc4335b8 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:42.016304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6d4d5e99-4a12-4e5a-b33d-3938b4767c84 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.174326 Jul 28 04:03:42.016739 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-63025f2b-d4ba-49e7-b9ea-7773fc4335b8 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:42.016986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-63025f2b-d4ba-49e7-b9ea-7773fc4335b8 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:42.017168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 326/638] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:03:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:03:42.030463 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4cdc4290-8a4a-4d3c-806c-56026880fc89 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:42.031382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4cdc4290-8a4a-4d3c-806c-56026880fc89 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:42.108478 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4cdc4290-8a4a-4d3c-806c-56026880fc89 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:42.116778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4cdc4290-8a4a-4d3c-806c-56026880fc89 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1237 microversion: 2.1 time: 0.092399 Jul 28 04:03:42.118566 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 327/639] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:42 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:42.264035 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-63025f2b-d4ba-49e7-b9ea-7773fc4335b8 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:42.274633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-63025f2b-d4ba-49e7-b9ea-7773fc4335b8 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1518 microversion: 2.1 time: 0.275821 Jul 28 04:03:42.275384 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 313/640] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:41 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1518 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:43.022010 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:43.022867 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:43.031197 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.031668 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.032743 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.033190 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.139998 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f473df16-ee06-4b75-ab07-e61200463ebb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:43.140827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f473df16-ee06-4b75-ab07-e61200463ebb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:43.152968 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f473df16-ee06-4b75-ab07-e61200463ebb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.154181 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f473df16-ee06-4b75-ab07-e61200463ebb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.156049 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f473df16-ee06-4b75-ab07-e61200463ebb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.157111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f473df16-ee06-4b75-ab07-e61200463ebb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.209223 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:43.220898 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:43.222570 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:43.223894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b0845145-2b76-4b79-92f1-0e43d3778793 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.206199 Jul 28 04:03:43.224611 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 328/641] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:43 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:43.238670 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f473df16-ee06-4b75-ab07-e61200463ebb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:43.253493 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f473df16-ee06-4b75-ab07-e61200463ebb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1241 microversion: 2.1 time: 0.118429 Jul 28 04:03:43.254274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 314/642] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:43 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:43.296609 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8707ba62-3e44-47cc-b0b8-25121266709e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:43.297224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8707ba62-3e44-47cc-b0b8-25121266709e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:43.303991 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8707ba62-3e44-47cc-b0b8-25121266709e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.304475 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8707ba62-3e44-47cc-b0b8-25121266709e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.305275 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8707ba62-3e44-47cc-b0b8-25121266709e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.305761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8707ba62-3e44-47cc-b0b8-25121266709e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.326377 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:43.456375 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8707ba62-3e44-47cc-b0b8-25121266709e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:43.464522 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8707ba62-3e44-47cc-b0b8-25121266709e tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1518 microversion: 2.1 time: 0.171673 Jul 28 04:03:43.465194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 329/643] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:43 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:44.251344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:44.252400 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:44.263128 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.263739 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.265133 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.265866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.286096 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d7cbc83b-726c-46a3-9d35-eac355c96427 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:44.287672 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d7cbc83b-726c-46a3-9d35-eac355c96427 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:44.295647 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:44.303711 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d7cbc83b-726c-46a3-9d35-eac355c96427 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.304565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d7cbc83b-726c-46a3-9d35-eac355c96427 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.305988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d7cbc83b-726c-46a3-9d35-eac355c96427 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.306790 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d7cbc83b-726c-46a3-9d35-eac355c96427 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.499298 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d7cbc83b-726c-46a3-9d35-eac355c96427 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:44.531462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d7cbc83b-726c-46a3-9d35-eac355c96427 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1241 microversion: 2.1 time: 0.248181 Jul 28 04:03:44.534084 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 330/644] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:44 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1241 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:44.553572 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-60a2c03b-f67f-4a6d-86b6-6fe7346cc2c0 req-a7a811f5-10c4-4312-a02b-9f72a80f6a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed19419-f0b9-473d-93cb-fefb8c29d74e", "name": "network-vif-unplugged", "status": "completed", "tag": "68bf49ef-5416-40a1-b99b-f3cd17caa288"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:44.576568 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-60a2c03b-f67f-4a6d-86b6-6fe7346cc2c0 req-a7a811f5-10c4-4312-a02b-9f72a80f6a4c service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.578378 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-60a2c03b-f67f-4a6d-86b6-6fe7346cc2c0 req-a7a811f5-10c4-4312-a02b-9f72a80f6a4c service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.605441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.compute.server_external_events [req-60a2c03b-f67f-4a6d-86b6-6fe7346cc2c0 req-a7a811f5-10c4-4312-a02b-9f72a80f6a4c service nova] Unable to find a host for instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e. Dropping event network-vif-unplugged {{(pid=135703) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 04:03:44.607755 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-60a2c03b-f67f-4a6d-86b6-6fe7346cc2c0 req-a7a811f5-10c4-4312-a02b-9f72a80f6a4c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.071415 Jul 28 04:03:44.610115 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 331/645] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 04:03:44.616618 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ddb640a8-b982-4e3d-b674-bf79ee16c199 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:44.617527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ddb640a8-b982-4e3d-b674-bf79ee16c199 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:44.625886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ddb640a8-b982-4e3d-b674-bf79ee16c199 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.626336 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ddb640a8-b982-4e3d-b674-bf79ee16c199 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.627119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ddb640a8-b982-4e3d-b674-bf79ee16c199 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.627570 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ddb640a8-b982-4e3d-b674-bf79ee16c199 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.724608 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:44.735073 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:44.736841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:44.738375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-64c83162-82b6-4646-82d6-c37976913482 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.492650 Jul 28 04:03:44.739146 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 315/646] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:44 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:03:44.803804 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ddb640a8-b982-4e3d-b674-bf79ee16c199 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:44.815098 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ddb640a8-b982-4e3d-b674-bf79ee16c199 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1520 microversion: 2.1 time: 0.203001 Jul 28 04:03:44.815735 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 332/647] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:44 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:45.569700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-280b36a1-862e-433e-b78b-ad44e8fa3fb3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:45.570440 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-280b36a1-862e-433e-b78b-ad44e8fa3fb3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:45.580326 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-280b36a1-862e-433e-b78b-ad44e8fa3fb3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.580869 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-280b36a1-862e-433e-b78b-ad44e8fa3fb3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.581818 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-280b36a1-862e-433e-b78b-ad44e8fa3fb3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.583305 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-280b36a1-862e-433e-b78b-ad44e8fa3fb3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.721274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-280b36a1-862e-433e-b78b-ad44e8fa3fb3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:45.736562 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-280b36a1-862e-433e-b78b-ad44e8fa3fb3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1297 microversion: 2.1 time: 0.170318 Jul 28 04:03:45.739085 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 316/648] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:45 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1297 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:45.776166 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:45.777099 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:45.785281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.785737 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.786736 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.787434 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.841244 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b746cd62-cd54-495a-a02c-2d5fe94457ca tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:45.841868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b746cd62-cd54-495a-a02c-2d5fe94457ca tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:45.848752 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b746cd62-cd54-495a-a02c-2d5fe94457ca tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.849198 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b746cd62-cd54-495a-a02c-2d5fe94457ca tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.849989 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b746cd62-cd54-495a-a02c-2d5fe94457ca tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.850428 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b746cd62-cd54-495a-a02c-2d5fe94457ca tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.096821 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:46.107855 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:46.109646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:46.111144 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d71d6c52-2a3d-4c52-9326-0b684a711664 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.349180 Jul 28 04:03:46.111936 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 333/649] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:45 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:46.114156 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b746cd62-cd54-495a-a02c-2d5fe94457ca tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:46.131321 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b746cd62-cd54-495a-a02c-2d5fe94457ca tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1520 microversion: 2.1 time: 0.295405 Jul 28 04:03:46.132919 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 317/650] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:45 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:46.661526 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-0050c83b-3b76-4e38-b2ad-af28aab6f56e req-29f12442-e9ce-47d6-b3a4-8716e8148dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29710033-f00f-435c-8485-9dd60d728f27", "name": "network-vif-plugged", "status": "completed", "tag": "de721302-c218-45d7-87a1-d79d5e51a7e4"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:46.685645 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-0050c83b-3b76-4e38-b2ad-af28aab6f56e req-29f12442-e9ce-47d6-b3a4-8716e8148dc1 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.686648 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-0050c83b-3b76-4e38-b2ad-af28aab6f56e req-29f12442-e9ce-47d6-b3a4-8716e8148dc1 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.722567 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-0050c83b-3b76-4e38-b2ad-af28aab6f56e req-29f12442-e9ce-47d6-b3a4-8716e8148dc1 service nova] Creating event network-vif-plugged:de721302-c218-45d7-87a1-d79d5e51a7e4 for instance 29710033-f00f-435c-8485-9dd60d728f27 on hv-cinder-85127 Jul 28 04:03:46.734564 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-0050c83b-3b76-4e38-b2ad-af28aab6f56e req-29f12442-e9ce-47d6-b3a4-8716e8148dc1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080591 Jul 28 04:03:46.735412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 334/651] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:46.777151 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d3f9cf57-8c97-4a1d-ab79-19c247773e97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:46.778663 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d3f9cf57-8c97-4a1d-ab79-19c247773e97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:46.789174 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d3f9cf57-8c97-4a1d-ab79-19c247773e97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.790013 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d3f9cf57-8c97-4a1d-ab79-19c247773e97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.791789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d3f9cf57-8c97-4a1d-ab79-19c247773e97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.792646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d3f9cf57-8c97-4a1d-ab79-19c247773e97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.092634 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d3f9cf57-8c97-4a1d-ab79-19c247773e97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:47.106202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d3f9cf57-8c97-4a1d-ab79-19c247773e97 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.333033 Jul 28 04:03:47.114387 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 318/652] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:46 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:47.152464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:47.154073 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:47.161509 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.162675 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.164145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.165509 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.169792 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-cddf760b-f76a-4ee9-ba21-c6e6d402d74c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:47.170922 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-cddf760b-f76a-4ee9-ba21-c6e6d402d74c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:47.191607 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cddf760b-f76a-4ee9-ba21-c6e6d402d74c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.192412 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cddf760b-f76a-4ee9-ba21-c6e6d402d74c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.193853 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cddf760b-f76a-4ee9-ba21-c6e6d402d74c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.194632 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cddf760b-f76a-4ee9-ba21-c6e6d402d74c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.363709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:47.373971 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:47.375537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:47.376884 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6031667f-184d-4349-b5ec-f3828cec28ee tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.230014 Jul 28 04:03:47.377466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 335/653] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:47 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:47.600708 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=10 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:47.676185 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cddf760b-f76a-4ee9-ba21-c6e6d402d74c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:47.684763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-cddf760b-f76a-4ee9-ba21-c6e6d402d74c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.533059 Jul 28 04:03:47.687034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 319/654] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:47 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:48.128742 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a09f2378-148e-4b6c-9ae0-642c46024c9f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:48.129699 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a09f2378-148e-4b6c-9ae0-642c46024c9f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:48.136933 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a09f2378-148e-4b6c-9ae0-642c46024c9f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.141206 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a09f2378-148e-4b6c-9ae0-642c46024c9f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.141206 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a09f2378-148e-4b6c-9ae0-642c46024c9f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.141206 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a09f2378-148e-4b6c-9ae0-642c46024c9f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.349035 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a09f2378-148e-4b6c-9ae0-642c46024c9f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:48.365818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a09f2378-148e-4b6c-9ae0-642c46024c9f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.240575 Jul 28 04:03:48.368459 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 336/655] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:48 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:48.404530 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:48.405842 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:48.415596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.415596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.415980 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.416394 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.647869 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:48.657704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:48.659335 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:48.660595 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-32c62bad-0b89-491b-8444-2f04b7a34adf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1408 microversion: 2.20 time: 0.261356 Jul 28 04:03:48.664544 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 320/656] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:48 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:03:48.711211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b4445815-b4e1-4229-8585-07061d14ec62 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:48.712698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b4445815-b4e1-4229-8585-07061d14ec62 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:48.722737 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4445815-b4e1-4229-8585-07061d14ec62 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.723545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4445815-b4e1-4229-8585-07061d14ec62 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.724728 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4445815-b4e1-4229-8585-07061d14ec62 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.725171 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b4445815-b4e1-4229-8585-07061d14ec62 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.749044 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-cd12f9ea-57fe-4609-87fc-64705c87499b req-b897336d-e5e8-473c-8cda-584453f3b275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70dc9074-c661-48fa-ba87-ef45db17143b", "tag": "03f6d4b3-f03e-4e79-9f11-0cea1b416098"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:48.768603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-cd12f9ea-57fe-4609-87fc-64705c87499b req-b897336d-e5e8-473c-8cda-584453f3b275 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.769472 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-cd12f9ea-57fe-4609-87fc-64705c87499b req-b897336d-e5e8-473c-8cda-584453f3b275 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.783322 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-cd12f9ea-57fe-4609-87fc-64705c87499b req-b897336d-e5e8-473c-8cda-584453f3b275 service nova] Creating event network-changed:03f6d4b3-f03e-4e79-9f11-0cea1b416098 for instance 70dc9074-c661-48fa-ba87-ef45db17143b on hv-cinder-85127 Jul 28 04:03:48.788866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-cd12f9ea-57fe-4609-87fc-64705c87499b req-b897336d-e5e8-473c-8cda-584453f3b275 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047444 Jul 28 04:03:48.790082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 321/657] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:48.963928 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b4445815-b4e1-4229-8585-07061d14ec62 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:48.973033 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b4445815-b4e1-4229-8585-07061d14ec62 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.269400 Jul 28 04:03:48.975304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 337/658] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:48 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:49.391426 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b34b63f5-1246-42d1-86c6-a3ee072872be tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:49.392434 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b34b63f5-1246-42d1-86c6-a3ee072872be tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:49.399417 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b34b63f5-1246-42d1-86c6-a3ee072872be tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.400061 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b34b63f5-1246-42d1-86c6-a3ee072872be tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.400872 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b34b63f5-1246-42d1-86c6-a3ee072872be tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.401312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b34b63f5-1246-42d1-86c6-a3ee072872be tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.686292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:49.687134 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:49.693393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.693845 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.694622 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.695055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.715023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b34b63f5-1246-42d1-86c6-a3ee072872be tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:49.728862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b34b63f5-1246-42d1-86c6-a3ee072872be tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.341605 Jul 28 04:03:49.740027 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 322/659] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:49 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:49.858877 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:49.871392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:49.873052 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:49.874808 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-bab79960-2d79-4db5-9a24-3804c764097e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1600 microversion: 2.20 time: 0.193095 Jul 28 04:03:49.875380 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 338/660] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:49 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1600 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:03:49.905846 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d4b278b2-66e3-43e5-b7e5-a099963aaedd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:49.906361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d4b278b2-66e3-43e5-b7e5-a099963aaedd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:49.912876 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d4b278b2-66e3-43e5-b7e5-a099963aaedd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.913394 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d4b278b2-66e3-43e5-b7e5-a099963aaedd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.914165 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d4b278b2-66e3-43e5-b7e5-a099963aaedd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.914608 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d4b278b2-66e3-43e5-b7e5-a099963aaedd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.960830 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0cec316d-938e-468f-acf2-a4e441479fc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:49.961532 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0cec316d-938e-468f-acf2-a4e441479fc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:49.968389 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cec316d-938e-468f-acf2-a4e441479fc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.968885 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cec316d-938e-468f-acf2-a4e441479fc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.969887 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cec316d-938e-468f-acf2-a4e441479fc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.970392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0cec316d-938e-468f-acf2-a4e441479fc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.064902 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d4b278b2-66e3-43e5-b7e5-a099963aaedd tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.162974 Jul 28 04:03:50.075771 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 323/661] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Jul 28 04:03:49 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:03:50.084363 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b41eaaaa-65fe-4ec8-8f5f-30cf21f603f5 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:50.088245 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b41eaaaa-65fe-4ec8-8f5f-30cf21f603f5 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:50.089671 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-0cec316d-938e-468f-acf2-a4e441479fc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lazy-loading 'services' on Instance uuid 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:50.101951 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b41eaaaa-65fe-4ec8-8f5f-30cf21f603f5 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.109106 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b41eaaaa-65fe-4ec8-8f5f-30cf21f603f5 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.112066 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b41eaaaa-65fe-4ec8-8f5f-30cf21f603f5 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.115003 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b41eaaaa-65fe-4ec8-8f5f-30cf21f603f5 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.396259 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b41eaaaa-65fe-4ec8-8f5f-30cf21f603f5 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:50.412219 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b41eaaaa-65fe-4ec8-8f5f-30cf21f603f5 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.332518 Jul 28 04:03:50.412219 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 324/662] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:50 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:50.437214 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0cec316d-938e-468f-acf2-a4e441479fc8 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments/198207d3-674a-4ae7-8a67-e2592f863c5d" status: 202 len: 0 microversion: 2.1 time: 0.480051 Jul 28 04:03:50.442730 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 339/663] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:03:49 2022] DELETE /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments/198207d3-674a-4ae7-8a67-e2592f863c5d => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:03:50.459503 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-82902b15-cacd-4b62-a910-7dd65fc9764b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:50.470320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-82902b15-cacd-4b62-a910-7dd65fc9764b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:50.488569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-82902b15-cacd-4b62-a910-7dd65fc9764b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.489816 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-82902b15-cacd-4b62-a910-7dd65fc9764b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.490880 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-82902b15-cacd-4b62-a910-7dd65fc9764b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.491580 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-82902b15-cacd-4b62-a910-7dd65fc9764b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.545037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-82902b15-cacd-4b62-a910-7dd65fc9764b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100370 Jul 28 04:03:50.548410 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 325/664] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:03:50 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:50.751893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8395db8f-6f28-4fa6-9687-3bffb018f8e2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:50.752639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8395db8f-6f28-4fa6-9687-3bffb018f8e2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:50.760610 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8395db8f-6f28-4fa6-9687-3bffb018f8e2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.760610 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8395db8f-6f28-4fa6-9687-3bffb018f8e2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.760610 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8395db8f-6f28-4fa6-9687-3bffb018f8e2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.760610 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8395db8f-6f28-4fa6-9687-3bffb018f8e2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.981093 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8395db8f-6f28-4fa6-9687-3bffb018f8e2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:50.989384 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8395db8f-6f28-4fa6-9687-3bffb018f8e2 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.242102 Jul 28 04:03:50.989963 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 340/665] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:50 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:51.440419 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-80a0651a-3249-49ad-a681-5768c403af9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:51.441542 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-80a0651a-3249-49ad-a681-5768c403af9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:51.453639 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-80a0651a-3249-49ad-a681-5768c403af9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.455330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-80a0651a-3249-49ad-a681-5768c403af9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.456850 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-80a0651a-3249-49ad-a681-5768c403af9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.457917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-80a0651a-3249-49ad-a681-5768c403af9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.468490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:51.478505 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-b1b106b1-9d1a-4e17-a3da-7ade33a49ba8 req-64cc8dc8-1b8d-4109-88ba-bc93390539e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29710033-f00f-435c-8485-9dd60d728f27", "tag": "de721302-c218-45d7-87a1-d79d5e51a7e4"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:51.490682 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-b1b106b1-9d1a-4e17-a3da-7ade33a49ba8 req-64cc8dc8-1b8d-4109-88ba-bc93390539e6 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.491145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-b1b106b1-9d1a-4e17-a3da-7ade33a49ba8 req-64cc8dc8-1b8d-4109-88ba-bc93390539e6 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.509988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-b1b106b1-9d1a-4e17-a3da-7ade33a49ba8 req-64cc8dc8-1b8d-4109-88ba-bc93390539e6 service nova] Creating event network-changed:de721302-c218-45d7-87a1-d79d5e51a7e4 for instance 29710033-f00f-435c-8485-9dd60d728f27 on hv-cinder-85127 Jul 28 04:03:51.516244 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-b1b106b1-9d1a-4e17-a3da-7ade33a49ba8 req-64cc8dc8-1b8d-4109-88ba-bc93390539e6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041984 Jul 28 04:03:51.517227 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 341/666] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:03:51.567022 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d71d6808-d700-4fde-9cab-cc9a23f51aa9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:51.571111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d71d6808-d700-4fde-9cab-cc9a23f51aa9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:51.584294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d71d6808-d700-4fde-9cab-cc9a23f51aa9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.585093 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d71d6808-d700-4fde-9cab-cc9a23f51aa9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.587767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d71d6808-d700-4fde-9cab-cc9a23f51aa9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.588756 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d71d6808-d700-4fde-9cab-cc9a23f51aa9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.636489 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d71d6808-d700-4fde-9cab-cc9a23f51aa9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078142 Jul 28 04:03:51.637784 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 342/667] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:03:51 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:51.679673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-80a0651a-3249-49ad-a681-5768c403af9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:51.688304 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-80a0651a-3249-49ad-a681-5768c403af9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.258158 Jul 28 04:03:51.688919 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 326/668] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:51 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:52.012152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f05c1747-1e4a-47c6-8c94-5d4810840e2d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:52.012958 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f05c1747-1e4a-47c6-8c94-5d4810840e2d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:52.015665 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:52.022279 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f05c1747-1e4a-47c6-8c94-5d4810840e2d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.022737 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f05c1747-1e4a-47c6-8c94-5d4810840e2d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.023611 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f05c1747-1e4a-47c6-8c94-5d4810840e2d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.024119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f05c1747-1e4a-47c6-8c94-5d4810840e2d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.114128 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=8 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:52.177904 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f05c1747-1e4a-47c6-8c94-5d4810840e2d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:52.189210 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f05c1747-1e4a-47c6-8c94-5d4810840e2d tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.181870 Jul 28 04:03:52.195650 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 343/669] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:52 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:52.649476 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4a525a9e-28a3-41b1-ac45-df68b5fd4d5b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:52.652011 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4a525a9e-28a3-41b1-ac45-df68b5fd4d5b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:52.658945 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a525a9e-28a3-41b1-ac45-df68b5fd4d5b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.663027 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a525a9e-28a3-41b1-ac45-df68b5fd4d5b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.663027 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a525a9e-28a3-41b1-ac45-df68b5fd4d5b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.663027 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4a525a9e-28a3-41b1-ac45-df68b5fd4d5b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.705290 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4a525a9e-28a3-41b1-ac45-df68b5fd4d5b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060011 Jul 28 04:03:52.705884 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 327/670] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:03:52 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:52.717581 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c6e02506-78f7-4953-85b5-160ff3741668 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:52.718464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c6e02506-78f7-4953-85b5-160ff3741668 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:52.729441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c6e02506-78f7-4953-85b5-160ff3741668 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.729916 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c6e02506-78f7-4953-85b5-160ff3741668 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.730720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c6e02506-78f7-4953-85b5-160ff3741668 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.731176 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c6e02506-78f7-4953-85b5-160ff3741668 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.949380 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c6e02506-78f7-4953-85b5-160ff3741668 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:52.958072 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c6e02506-78f7-4953-85b5-160ff3741668 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.244510 Jul 28 04:03:52.959258 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 344/671] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:52 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:53.213769 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-871c120a-241b-4a97-af8a-aa2337686335 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:53.214308 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-871c120a-241b-4a97-af8a-aa2337686335 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:53.221284 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-871c120a-241b-4a97-af8a-aa2337686335 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.221733 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-871c120a-241b-4a97-af8a-aa2337686335 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.222664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-871c120a-241b-4a97-af8a-aa2337686335 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.223108 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-871c120a-241b-4a97-af8a-aa2337686335 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.386001 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-871c120a-241b-4a97-af8a-aa2337686335 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:53.398920 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-871c120a-241b-4a97-af8a-aa2337686335 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.190044 Jul 28 04:03:53.399560 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 328/672] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:53 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:53.720658 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-11d730cd-501c-42cb-80f4-577688680efa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:53.722809 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-11d730cd-501c-42cb-80f4-577688680efa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:53.731060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-11d730cd-501c-42cb-80f4-577688680efa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.731527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-11d730cd-501c-42cb-80f4-577688680efa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.732370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-11d730cd-501c-42cb-80f4-577688680efa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.732817 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-11d730cd-501c-42cb-80f4-577688680efa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.765509 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-11d730cd-501c-42cb-80f4-577688680efa tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048851 Jul 28 04:03:53.766097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 345/673] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:03:53 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:03:53.850756 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3e7432a1-12bf-49cc-bf8b-a57b6d56ae76 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:53.851643 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3e7432a1-12bf-49cc-bf8b-a57b6d56ae76 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:53.862234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3e7432a1-12bf-49cc-bf8b-a57b6d56ae76 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.863034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3e7432a1-12bf-49cc-bf8b-a57b6d56ae76 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.864517 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3e7432a1-12bf-49cc-bf8b-a57b6d56ae76 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.865341 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3e7432a1-12bf-49cc-bf8b-a57b6d56ae76 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.907099 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3e7432a1-12bf-49cc-bf8b-a57b6d56ae76 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:03:53.986667 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ba3bc794-4f11-4f45-babe-d26b5e4f3f32 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:53.987203 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ba3bc794-4f11-4f45-babe-d26b5e4f3f32 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:53.995944 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ba3bc794-4f11-4f45-babe-d26b5e4f3f32 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.000368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ba3bc794-4f11-4f45-babe-d26b5e4f3f32 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.000368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ba3bc794-4f11-4f45-babe-d26b5e4f3f32 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.000368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ba3bc794-4f11-4f45-babe-d26b5e4f3f32 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.142855 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ba3bc794-4f11-4f45-babe-d26b5e4f3f32 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:54.156995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ba3bc794-4f11-4f45-babe-d26b5e4f3f32 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.174329 Jul 28 04:03:54.157885 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 346/674] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:53 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:54.246147 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3e7432a1-12bf-49cc-bf8b-a57b6d56ae76 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 204 len: 0 microversion: 2.1 time: 0.402460 Jul 28 04:03:54.246721 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 329/675] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:03:53 2022] DELETE /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:03:54.260111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-29b4bff1-493b-4ba7-8e17-a675f060b978 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:54.261233 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-29b4bff1-493b-4ba7-8e17-a675f060b978 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:54.271288 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-29b4bff1-493b-4ba7-8e17-a675f060b978 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.271744 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-29b4bff1-493b-4ba7-8e17-a675f060b978 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.273442 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-29b4bff1-493b-4ba7-8e17-a675f060b978 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.273442 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-29b4bff1-493b-4ba7-8e17-a675f060b978 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.296241 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:54.419986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-29b4bff1-493b-4ba7-8e17-a675f060b978 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:54.422979 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f679d357-2706-4272-af6b-0c15c1f03649 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:54.423690 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f679d357-2706-4272-af6b-0c15c1f03649 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:54.431916 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-29b4bff1-493b-4ba7-8e17-a675f060b978 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1692 microversion: 2.1 time: 0.177885 Jul 28 04:03:54.432767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 347/676] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:54 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:54.437859 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f679d357-2706-4272-af6b-0c15c1f03649 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.438875 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f679d357-2706-4272-af6b-0c15c1f03649 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.439846 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f679d357-2706-4272-af6b-0c15c1f03649 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.440491 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f679d357-2706-4272-af6b-0c15c1f03649 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.599577 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f679d357-2706-4272-af6b-0c15c1f03649 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:54.608019 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f679d357-2706-4272-af6b-0c15c1f03649 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.190379 Jul 28 04:03:54.608779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 330/677] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:54 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:55.178920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6c966501-4194-41e5-9871-a67f4f704394 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:55.179479 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6c966501-4194-41e5-9871-a67f4f704394 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:55.186773 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c966501-4194-41e5-9871-a67f4f704394 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.187227 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c966501-4194-41e5-9871-a67f4f704394 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.188029 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c966501-4194-41e5-9871-a67f4f704394 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.188520 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c966501-4194-41e5-9871-a67f4f704394 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.331523 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6c966501-4194-41e5-9871-a67f4f704394 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:55.339620 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6c966501-4194-41e5-9871-a67f4f704394 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.164697 Jul 28 04:03:55.340230 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 348/678] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:55 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:55.453858 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1cae404e-3c56-43c8-9721-4b31d1ce9256 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:55.454563 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1cae404e-3c56-43c8-9721-4b31d1ce9256 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:55.461219 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1cae404e-3c56-43c8-9721-4b31d1ce9256 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.461748 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1cae404e-3c56-43c8-9721-4b31d1ce9256 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.462520 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1cae404e-3c56-43c8-9721-4b31d1ce9256 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.462961 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1cae404e-3c56-43c8-9721-4b31d1ce9256 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.612141 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1cae404e-3c56-43c8-9721-4b31d1ce9256 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:55.620893 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1cae404e-3c56-43c8-9721-4b31d1ce9256 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1692 microversion: 2.1 time: 0.171283 Jul 28 04:03:55.621469 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 331/679] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:55 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:55.894310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c4060bf8-c98c-4657-a575-e215573ac990 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:55.896686 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c4060bf8-c98c-4657-a575-e215573ac990 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:55.908162 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4060bf8-c98c-4657-a575-e215573ac990 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.909063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4060bf8-c98c-4657-a575-e215573ac990 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.910532 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4060bf8-c98c-4657-a575-e215573ac990 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.911326 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c4060bf8-c98c-4657-a575-e215573ac990 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.098067 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c4060bf8-c98c-4657-a575-e215573ac990 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:56.106775 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c4060bf8-c98c-4657-a575-e215573ac990 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.480371 Jul 28 04:03:56.107373 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 349/680] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:55 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:56.361871 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-445f2ac7-1e17-41e5-bb34-0f0cab1d77aa tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:56.362580 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-445f2ac7-1e17-41e5-bb34-0f0cab1d77aa tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:56.372772 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-445f2ac7-1e17-41e5-bb34-0f0cab1d77aa tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.373864 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-445f2ac7-1e17-41e5-bb34-0f0cab1d77aa tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.375234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-445f2ac7-1e17-41e5-bb34-0f0cab1d77aa tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.376066 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-445f2ac7-1e17-41e5-bb34-0f0cab1d77aa tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.538297 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-445f2ac7-1e17-41e5-bb34-0f0cab1d77aa tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:56.547407 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-445f2ac7-1e17-41e5-bb34-0f0cab1d77aa tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.189381 Jul 28 04:03:56.548026 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 332/681] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:56 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:56.642803 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1cd4bfe4-d52b-4954-884f-ca7c248ee20f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:56.643664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1cd4bfe4-d52b-4954-884f-ca7c248ee20f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:56.651772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1cd4bfe4-d52b-4954-884f-ca7c248ee20f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.652270 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1cd4bfe4-d52b-4954-884f-ca7c248ee20f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.653078 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1cd4bfe4-d52b-4954-884f-ca7c248ee20f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.653534 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1cd4bfe4-d52b-4954-884f-ca7c248ee20f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.765010 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-c5c06d83-ceda-4e90-8a48-a95970af820c req-a25e8fc5-31b9-4f84-a5fa-ae565f9fdad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dc9074-c661-48fa-ba87-ef45db17143b", "name": "network-vif-plugged", "status": "completed", "tag": "03f6d4b3-f03e-4e79-9f11-0cea1b416098"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:56.784345 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-c5c06d83-ceda-4e90-8a48-a95970af820c req-a25e8fc5-31b9-4f84-a5fa-ae565f9fdad6 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.785432 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-c5c06d83-ceda-4e90-8a48-a95970af820c req-a25e8fc5-31b9-4f84-a5fa-ae565f9fdad6 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.802301 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-c5c06d83-ceda-4e90-8a48-a95970af820c req-a25e8fc5-31b9-4f84-a5fa-ae565f9fdad6 service nova] Creating event network-vif-plugged:03f6d4b3-f03e-4e79-9f11-0cea1b416098 for instance 70dc9074-c661-48fa-ba87-ef45db17143b on hv-cinder-85127 Jul 28 04:03:56.808073 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-c5c06d83-ceda-4e90-8a48-a95970af820c req-a25e8fc5-31b9-4f84-a5fa-ae565f9fdad6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051263 Jul 28 04:03:56.808704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 333/682] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:56.829772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1cd4bfe4-d52b-4954-884f-ca7c248ee20f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:56.838815 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1cd4bfe4-d52b-4954-884f-ca7c248ee20f tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1692 microversion: 2.1 time: 0.199905 Jul 28 04:03:56.839418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 350/683] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:56 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:57.132901 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a677078b-7ed1-4c19-96fe-bf0dab75eb6b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:57.143330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a677078b-7ed1-4c19-96fe-bf0dab75eb6b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:57.143330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a677078b-7ed1-4c19-96fe-bf0dab75eb6b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.143330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a677078b-7ed1-4c19-96fe-bf0dab75eb6b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:57.143330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a677078b-7ed1-4c19-96fe-bf0dab75eb6b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.143723 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a677078b-7ed1-4c19-96fe-bf0dab75eb6b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:57.287390 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a677078b-7ed1-4c19-96fe-bf0dab75eb6b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:57.296616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a677078b-7ed1-4c19-96fe-bf0dab75eb6b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.167680 Jul 28 04:03:57.297201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 334/684] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:57 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:57.570039 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fdf1ff53-0184-46cc-8fc8-44fdc765410c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:57.570903 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fdf1ff53-0184-46cc-8fc8-44fdc765410c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:57.578052 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fdf1ff53-0184-46cc-8fc8-44fdc765410c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.578515 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fdf1ff53-0184-46cc-8fc8-44fdc765410c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:57.579318 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fdf1ff53-0184-46cc-8fc8-44fdc765410c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.579773 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fdf1ff53-0184-46cc-8fc8-44fdc765410c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:57.740065 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fdf1ff53-0184-46cc-8fc8-44fdc765410c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:57.749839 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fdf1ff53-0184-46cc-8fc8-44fdc765410c tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.183708 Jul 28 04:03:57.750464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 351/685] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:57 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:57.860695 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c34d2d44-8fd5-4e0d-b998-c1493d9167c3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:57.861228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c34d2d44-8fd5-4e0d-b998-c1493d9167c3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:57.868875 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c34d2d44-8fd5-4e0d-b998-c1493d9167c3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.869329 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c34d2d44-8fd5-4e0d-b998-c1493d9167c3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:57.870123 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c34d2d44-8fd5-4e0d-b998-c1493d9167c3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.870566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c34d2d44-8fd5-4e0d-b998-c1493d9167c3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:58.017059 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c34d2d44-8fd5-4e0d-b998-c1493d9167c3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:58.025389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c34d2d44-8fd5-4e0d-b998-c1493d9167c3 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1692 microversion: 2.1 time: 0.168996 Jul 28 04:03:58.025973 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 335/686] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:57 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:58.318354 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-472a26c9-cb98-4054-9870-0a2c7a153b2b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:58.318972 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-472a26c9-cb98-4054-9870-0a2c7a153b2b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:58.325828 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-472a26c9-cb98-4054-9870-0a2c7a153b2b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:58.326281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-472a26c9-cb98-4054-9870-0a2c7a153b2b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:58.327079 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-472a26c9-cb98-4054-9870-0a2c7a153b2b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:58.327523 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-472a26c9-cb98-4054-9870-0a2c7a153b2b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:58.481033 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-472a26c9-cb98-4054-9870-0a2c7a153b2b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:58.494031 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-472a26c9-cb98-4054-9870-0a2c7a153b2b tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.178340 Jul 28 04:03:58.495118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 352/687] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:58 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:58.771314 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-bcdda476-d0f6-4ddf-afec-20d4ff375fd4 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:58.771989 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-bcdda476-d0f6-4ddf-afec-20d4ff375fd4 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:58.780677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bcdda476-d0f6-4ddf-afec-20d4ff375fd4 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:58.781422 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bcdda476-d0f6-4ddf-afec-20d4ff375fd4 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:58.782484 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bcdda476-d0f6-4ddf-afec-20d4ff375fd4 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:58.782997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bcdda476-d0f6-4ddf-afec-20d4ff375fd4 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.029518 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bcdda476-d0f6-4ddf-afec-20d4ff375fd4 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:59.037461 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-bcdda476-d0f6-4ddf-afec-20d4ff375fd4 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.270128 Jul 28 04:03:59.038061 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 336/688] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:58 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:59.048142 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-55fcb463-03e7-4307-b8b7-4d2f27888352 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:59.049698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-55fcb463-03e7-4307-b8b7-4d2f27888352 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:59.061109 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55fcb463-03e7-4307-b8b7-4d2f27888352 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.062019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55fcb463-03e7-4307-b8b7-4d2f27888352 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.063239 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55fcb463-03e7-4307-b8b7-4d2f27888352 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.064047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55fcb463-03e7-4307-b8b7-4d2f27888352 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.210879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-55fcb463-03e7-4307-b8b7-4d2f27888352 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:59.219209 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-55fcb463-03e7-4307-b8b7-4d2f27888352 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1692 microversion: 2.1 time: 0.175896 Jul 28 04:03:59.219805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 353/689] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:59 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:59.515787 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-5f072ecd-ef7d-4343-bd26-eaf955934e8f req-07f8b565-f132-4673-9949-18b5f47682b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b", "name": "network-vif-deleted", "tag": "d2c58462-fb66-479c-9106-a98477b390b4"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:59.517988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0998c1db-0123-4760-a4ed-49424ef2e62a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:59.518610 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0998c1db-0123-4760-a4ed-49424ef2e62a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:59.526121 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0998c1db-0123-4760-a4ed-49424ef2e62a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.526579 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0998c1db-0123-4760-a4ed-49424ef2e62a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.527068 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-5f072ecd-ef7d-4343-bd26-eaf955934e8f req-07f8b565-f132-4673-9949-18b5f47682b4 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.527370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0998c1db-0123-4760-a4ed-49424ef2e62a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.527703 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-5f072ecd-ef7d-4343-bd26-eaf955934e8f req-07f8b565-f132-4673-9949-18b5f47682b4 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.527822 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0998c1db-0123-4760-a4ed-49424ef2e62a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.541040 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-5f072ecd-ef7d-4343-bd26-eaf955934e8f req-07f8b565-f132-4673-9949-18b5f47682b4 service nova] Creating event network-vif-deleted:d2c58462-fb66-479c-9106-a98477b390b4 for instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b on hv-cinder-85127 Jul 28 04:03:59.547813 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-5f072ecd-ef7d-4343-bd26-eaf955934e8f req-07f8b565-f132-4673-9949-18b5f47682b4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035178 Jul 28 04:03:59.551343 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 337/690] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:59.688916 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0998c1db-0123-4760-a4ed-49424ef2e62a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:59.700161 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0998c1db-0123-4760-a4ed-49424ef2e62a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1362 microversion: 2.1 time: 0.186085 Jul 28 04:03:59.701422 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 354/691] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:59 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:00.072820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-321a4717-cb38-41ba-a626-099376528b20 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:00.073651 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-321a4717-cb38-41ba-a626-099376528b20 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:00.080878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-321a4717-cb38-41ba-a626-099376528b20 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:00.081332 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-321a4717-cb38-41ba-a626-099376528b20 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:00.082134 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-321a4717-cb38-41ba-a626-099376528b20 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:00.082575 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-321a4717-cb38-41ba-a626-099376528b20 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:00.241112 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-321a4717-cb38-41ba-a626-099376528b20 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:00.241449 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:00.242161 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:00.249969 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:00.250414 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:00.251407 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:00.252068 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:00.253497 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-321a4717-cb38-41ba-a626-099376528b20 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.186195 Jul 28 04:04:00.254415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 338/692] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:00 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:00.288104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:00.288559 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:00.289020 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lazy-loading 'fault' on Instance uuid 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:04:00.339989 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:00.348883 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-39e15a49-caf6-46fa-8a5c-a75244bdd44c tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 200 len: 1336 microversion: 2.1 time: 0.111555 Jul 28 04:04:00.363984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 355/693] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:00 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:00.727525 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-780a21cf-1b50-40d8-ad80-abb2593440e3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:00.728703 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-780a21cf-1b50-40d8-ad80-abb2593440e3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:00.740180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-780a21cf-1b50-40d8-ad80-abb2593440e3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:00.741061 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-780a21cf-1b50-40d8-ad80-abb2593440e3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:00.742434 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-780a21cf-1b50-40d8-ad80-abb2593440e3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:00.743800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-780a21cf-1b50-40d8-ad80-abb2593440e3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:00.940205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-780a21cf-1b50-40d8-ad80-abb2593440e3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:00.954964 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-780a21cf-1b50-40d8-ad80-abb2593440e3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1547 microversion: 2.1 time: 0.235193 Jul 28 04:04:00.956068 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 339/694] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:00 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1547 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:00.995874 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8bcb5194-34ae-416d-bbda-9e9469f07ede tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:00.996806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8bcb5194-34ae-416d-bbda-9e9469f07ede tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:01.008340 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8bcb5194-34ae-416d-bbda-9e9469f07ede tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:01.009369 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8bcb5194-34ae-416d-bbda-9e9469f07ede tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:01.012193 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8bcb5194-34ae-416d-bbda-9e9469f07ede tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:01.012193 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8bcb5194-34ae-416d-bbda-9e9469f07ede tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:01.155383 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8bcb5194-34ae-416d-bbda-9e9469f07ede tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167824 Jul 28 04:04:01.156219 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 356/695] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Jul 28 04:04:00 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:01.281184 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d0384b52-e088-41cf-ab82-e1271de19a9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:01.282468 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d0384b52-e088-41cf-ab82-e1271de19a9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:01.316140 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0384b52-e088-41cf-ab82-e1271de19a9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:01.319375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0384b52-e088-41cf-ab82-e1271de19a9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:01.321506 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0384b52-e088-41cf-ab82-e1271de19a9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:01.322225 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0384b52-e088-41cf-ab82-e1271de19a9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:01.386590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:01.388881 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:01.402463 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:01.403704 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:01.406056 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:01.408056 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:01.431751 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] HTTP exception thrown: Instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b could not be found. Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Request method failure captured: Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b HTTP/1.1 Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmKWLvqHiajw7Vtw-f2vvp_0YIjU3hSWiY17ioucOls7t40OrsIG6OSQelvM8vSidvlTrUkQl_D2V_jlVb0xPoWv0cI31HO1ossk5jJ2gT7TKd33Bz9cKC_3eCS5JpW3XRsx57me7iAOdWTxirrq9O4DR5qeUqvuAN28zh0ABaN-l0 Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:04:01.434405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8bf7f0f7880a435ba552361bcb31ef91", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}] Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 4251e84650f047c9a6eb0c3b16b25564 Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b could not be found. Jul 28 04:04:01.435925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b'} Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b could not be found. Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:01.437045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b could not be found. Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b could not be found. Jul 28 04:04:01.438653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:01.443030 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Returning 404 to user: Instance 4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:01.444481 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2f8f7701-033d-46cd-8d50-e3aca07a5a3e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b" status: 404 len: 111 microversion: 2.1 time: 0.066493 Jul 28 04:04:01.445610 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 357/696] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:01 2022] GET /compute/v2.1/servers/4e3f54fe-e7ea-4c2c-9c35-a0145ea1800b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:04:01.456726 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-29fcda62-0b37-4768-9d6e-f603f7fa91f0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '.version_select at 0x7f5572db5280>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:01.486034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d0384b52-e088-41cf-ab82-e1271de19a9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:01.496309 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d0384b52-e088-41cf-ab82-e1271de19a9b tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.223811 Jul 28 04:04:01.501524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 340/697] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:01 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:01.567719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-29fcda62-0b37-4768-9d6e-f603f7fa91f0 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414986290" status: 202 len: 0 microversion: 2.1 time: 0.116016 Jul 28 04:04:01.568410 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 358/698] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Jul 28 04:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414986290 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:04:02.533603 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-96dd426c-b8db-45fd-b848-931d116c36e3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:02.534795 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-96dd426c-b8db-45fd-b848-931d116c36e3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:02.563930 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-96dd426c-b8db-45fd-b848-931d116c36e3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:02.569188 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-96dd426c-b8db-45fd-b848-931d116c36e3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:02.573220 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-96dd426c-b8db-45fd-b848-931d116c36e3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:02.574128 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-96dd426c-b8db-45fd-b848-931d116c36e3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:02.625890 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-e358f687-808d-40a8-9a60-0bbe9a32b980 req-eccce437-5463-4475-a542-e9170a260c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed19419-f0b9-473d-93cb-fefb8c29d74e", "name": "network-vif-plugged", "status": "completed", "tag": "68bf49ef-5416-40a1-b99b-f3cd17caa288"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:02.666875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-e358f687-808d-40a8-9a60-0bbe9a32b980 req-eccce437-5463-4475-a542-e9170a260c33 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:02.667764 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-e358f687-808d-40a8-9a60-0bbe9a32b980 req-eccce437-5463-4475-a542-e9170a260c33 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:02.706126 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-e358f687-808d-40a8-9a60-0bbe9a32b980 req-eccce437-5463-4475-a542-e9170a260c33 service nova] Creating event network-vif-plugged:68bf49ef-5416-40a1-b99b-f3cd17caa288 for instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e on hv-cinder-85127 Jul 28 04:04:02.716710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-e358f687-808d-40a8-9a60-0bbe9a32b980 req-eccce437-5463-4475-a542-e9170a260c33 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103818 Jul 28 04:04:02.718648 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 359/699] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:02.732077 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-94b3be1e-da99-44ab-8b17-54a96a30fff5 req-04d356ff-445a-4d69-ab5b-a51d5c913ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70dc9074-c661-48fa-ba87-ef45db17143b", "tag": "03f6d4b3-f03e-4e79-9f11-0cea1b416098"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:02.756697 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-94b3be1e-da99-44ab-8b17-54a96a30fff5 req-04d356ff-445a-4d69-ab5b-a51d5c913ac3 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:02.757873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-94b3be1e-da99-44ab-8b17-54a96a30fff5 req-04d356ff-445a-4d69-ab5b-a51d5c913ac3 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:02.786829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-94b3be1e-da99-44ab-8b17-54a96a30fff5 req-04d356ff-445a-4d69-ab5b-a51d5c913ac3 service nova] Creating event network-changed:03f6d4b3-f03e-4e79-9f11-0cea1b416098 for instance 70dc9074-c661-48fa-ba87-ef45db17143b on hv-cinder-85127 Jul 28 04:04:02.798438 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-94b3be1e-da99-44ab-8b17-54a96a30fff5 req-04d356ff-445a-4d69-ab5b-a51d5c913ac3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076738 Jul 28 04:04:02.800317 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 360/700] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:02.897620 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-96dd426c-b8db-45fd-b848-931d116c36e3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:02.907420 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-96dd426c-b8db-45fd-b848-931d116c36e3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.381319 Jul 28 04:04:02.920179 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 341/701] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:02 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:03.931866 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aa8ec851-bbab-469d-9198-9b02545f9e28 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:03.932782 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-aa8ec851-bbab-469d-9198-9b02545f9e28 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:03.942095 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aa8ec851-bbab-469d-9198-9b02545f9e28 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:03.942768 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aa8ec851-bbab-469d-9198-9b02545f9e28 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:03.943692 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aa8ec851-bbab-469d-9198-9b02545f9e28 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:03.944265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aa8ec851-bbab-469d-9198-9b02545f9e28 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:04.169797 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-aa8ec851-bbab-469d-9198-9b02545f9e28 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:04.188102 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-aa8ec851-bbab-469d-9198-9b02545f9e28 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1576 microversion: 2.1 time: 0.261163 Jul 28 04:04:04.194468 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 361/702] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:03 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:04.789023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5e1f41cb-d106-47b6-bf2d-5cc1a5b89d99 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:04.789838 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5e1f41cb-d106-47b6-bf2d-5cc1a5b89d99 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:04.796604 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e1f41cb-d106-47b6-bf2d-5cc1a5b89d99 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:04.797063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e1f41cb-d106-47b6-bf2d-5cc1a5b89d99 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:04.797964 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e1f41cb-d106-47b6-bf2d-5cc1a5b89d99 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:04.798455 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e1f41cb-d106-47b6-bf2d-5cc1a5b89d99 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:04.818129 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:04.831031 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5e1f41cb-d106-47b6-bf2d-5cc1a5b89d99 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/ips" status: 200 len: 150 microversion: 2.1 time: 0.245197 Jul 28 04:04:04.831683 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 342/703] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 04:04:04 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/ips => generated 150 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:05.215055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e16f10b8-2c74-43b7-8f67-62b2bb947f87 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:05.216320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e16f10b8-2c74-43b7-8f67-62b2bb947f87 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:05.229505 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e16f10b8-2c74-43b7-8f67-62b2bb947f87 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:05.230316 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e16f10b8-2c74-43b7-8f67-62b2bb947f87 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:05.231726 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e16f10b8-2c74-43b7-8f67-62b2bb947f87 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:05.232520 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e16f10b8-2c74-43b7-8f67-62b2bb947f87 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:05.429707 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-e16f10b8-2c74-43b7-8f67-62b2bb947f87 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:05.438878 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e16f10b8-2c74-43b7-8f67-62b2bb947f87 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1563 microversion: 2.1 time: 0.231608 Jul 28 04:04:05.439471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 362/704] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:05 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:05.519699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-97b50d7a-aacb-4b55-b7cc-11f2a4642e08 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:05.520656 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-97b50d7a-aacb-4b55-b7cc-11f2a4642e08 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:05.534744 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-97b50d7a-aacb-4b55-b7cc-11f2a4642e08 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:05.535648 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-97b50d7a-aacb-4b55-b7cc-11f2a4642e08 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:05.537013 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-97b50d7a-aacb-4b55-b7cc-11f2a4642e08 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:05.537916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-97b50d7a-aacb-4b55-b7cc-11f2a4642e08 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:05.573661 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-97b50d7a-aacb-4b55-b7cc-11f2a4642e08 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:04:05.957064 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-97b50d7a-aacb-4b55-b7cc-11f2a4642e08 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 204 len: 0 microversion: 2.1 time: 0.446820 Jul 28 04:04:05.957963 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 343/705] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:04:05 2022] DELETE /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:04:05.966954 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9418c2c1-e334-4dd8-8f22-b0afbd80af85 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:05.967589 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9418c2c1-e334-4dd8-8f22-b0afbd80af85 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:05.974642 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9418c2c1-e334-4dd8-8f22-b0afbd80af85 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:05.975433 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9418c2c1-e334-4dd8-8f22-b0afbd80af85 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:05.978646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9418c2c1-e334-4dd8-8f22-b0afbd80af85 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:05.978646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9418c2c1-e334-4dd8-8f22-b0afbd80af85 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.135000 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9418c2c1-e334-4dd8-8f22-b0afbd80af85 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:06.143234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9418c2c1-e334-4dd8-8f22-b0afbd80af85 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1508 microversion: 2.1 time: 0.180200 Jul 28 04:04:06.143845 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 363/706] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:05 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:06.706419 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6b01bfa6-530e-411d-95a5-00571d372604 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d70da08-b77a-4f6e-a2e8-f6d54e5efe73"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:06.709037 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6b01bfa6-530e-411d-95a5-00571d372604 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:06.716434 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6b01bfa6-530e-411d-95a5-00571d372604 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.716893 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6b01bfa6-530e-411d-95a5-00571d372604 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.717692 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6b01bfa6-530e-411d-95a5-00571d372604 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.718137 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6b01bfa6-530e-411d-95a5-00571d372604 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:07.290959 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1f3d7567-741e-4818-abe3-0fc3ed39e58e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:07.291595 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1f3d7567-741e-4818-abe3-0fc3ed39e58e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:07.298159 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1f3d7567-741e-4818-abe3-0fc3ed39e58e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:07.298619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1f3d7567-741e-4818-abe3-0fc3ed39e58e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:07.299427 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1f3d7567-741e-4818-abe3-0fc3ed39e58e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:07.299882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1f3d7567-741e-4818-abe3-0fc3ed39e58e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:07.447757 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1f3d7567-741e-4818-abe3-0fc3ed39e58e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:07.456060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1f3d7567-741e-4818-abe3-0fc3ed39e58e tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1508 microversion: 2.1 time: 0.295337 Jul 28 04:04:07.456651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 364/707] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:07 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:08.478690 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-31004655-2dab-4e05-bb04-c59d046e9c7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:08.485773 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-31004655-2dab-4e05-bb04-c59d046e9c7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:08.486064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-31004655-2dab-4e05-bb04-c59d046e9c7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:08.486558 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-31004655-2dab-4e05-bb04-c59d046e9c7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:08.487351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-31004655-2dab-4e05-bb04-c59d046e9c7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:08.487798 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-31004655-2dab-4e05-bb04-c59d046e9c7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:08.646861 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-31004655-2dab-4e05-bb04-c59d046e9c7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:08.662152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-31004655-2dab-4e05-bb04-c59d046e9c7b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1508 microversion: 2.1 time: 0.187518 Jul 28 04:04:08.663164 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 365/708] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:08 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:08.853575 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6b01bfa6-530e-411d-95a5-00571d372604 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.150585 Jul 28 04:04:08.854470 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 344/709] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:04:06 2022] POST /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments => generated 194 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:09.263487 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-8d4dc86f-a0ee-4601-b9ac-1add0654e7ac req-8aa511e1-3e0c-4174-ab96-3f7ecf131318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0a06d3-c137-4eba-a44e-271a29b12e38", "name": "network-vif-deleted", "tag": "17c86bfa-053e-4c3a-bef0-ab77101531bb"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:09.274419 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-8d4dc86f-a0ee-4601-b9ac-1add0654e7ac req-8aa511e1-3e0c-4174-ab96-3f7ecf131318 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:09.274892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-8d4dc86f-a0ee-4601-b9ac-1add0654e7ac req-8aa511e1-3e0c-4174-ab96-3f7ecf131318 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:09.288715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-8d4dc86f-a0ee-4601-b9ac-1add0654e7ac req-8aa511e1-3e0c-4174-ab96-3f7ecf131318 service nova] Creating event network-vif-deleted:17c86bfa-053e-4c3a-bef0-ab77101531bb for instance 2c0a06d3-c137-4eba-a44e-271a29b12e38 on hv-cinder-85127 Jul 28 04:04:09.294749 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-8d4dc86f-a0ee-4601-b9ac-1add0654e7ac req-8aa511e1-3e0c-4174-ab96-3f7ecf131318 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034918 Jul 28 04:04:09.295349 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 366/710] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:09.696730 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:09.697554 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:09.705077 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:09.705537 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:09.706493 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:09.706951 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:09.748043 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:09.748769 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:09.749233 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lazy-loading 'fault' on Instance uuid 2c0a06d3-c137-4eba-a44e-271a29b12e38 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:04:09.811794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:09.820020 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-cbbe1fec-b196-4fd9-82f2-ce94d18ce1bb tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 200 len: 1312 microversion: 2.1 time: 0.130176 Jul 28 04:04:09.820695 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 345/711] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:09 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:10.850479 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:10.851115 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: 2c0a06d3-c137-4eba-a44e-271a29b12e38] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:10.859060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:10.859515 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:10.860351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:10.860851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:10.876388 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] HTTP exception thrown: Instance 2c0a06d3-c137-4eba-a44e-271a29b12e38 could not be found. Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Request method failure captured: Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 HTTP/1.1 Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmKWLvqHiajw7Vtw-f2vvp_0YIjU3hSWiY17ioucOls7t40OrsIG6OSQelvM8vSidvlTrUkQl_D2V_jlVb0xPoWv0cI31HO1ossk5jJ2gT7TKd33Bz9cKC_3eCS5JpW3XRsx57me7iAOdWTxirrq9O4DR5qeUqvuAN28zh0ABaN-l0 Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:04:10.878061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8bf7f0f7880a435ba552361bcb31ef91", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}] Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 4251e84650f047c9a6eb0c3b16b25564 Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 2c0a06d3-c137-4eba-a44e-271a29b12e38 could not be found. Jul 28 04:04:10.880350 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '2c0a06d3-c137-4eba-a44e-271a29b12e38'} Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c0a06d3-c137-4eba-a44e-271a29b12e38 could not be found. Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:10.881304 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c0a06d3-c137-4eba-a44e-271a29b12e38 could not be found. Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c0a06d3-c137-4eba-a44e-271a29b12e38 could not be found. Jul 28 04:04:10.882786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:10.885299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Returning 404 to user: Instance 2c0a06d3-c137-4eba-a44e-271a29b12e38 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:10.885299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fcfdccd1-f9bf-4cd8-8482-0ac35c635de4 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38" status: 404 len: 111 microversion: 2.1 time: 0.034186 Jul 28 04:04:10.885299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 367/712] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:10 2022] GET /compute/v2.1/servers/2c0a06d3-c137-4eba-a44e-271a29b12e38 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:04:10.893104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3ceb4415-ba1b-4330-9ca8-4a677f42b70b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:10.893851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3ceb4415-ba1b-4330-9ca8-4a677f42b70b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:10.896555 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:10.902753 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3ceb4415-ba1b-4330-9ca8-4a677f42b70b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:10.903207 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3ceb4415-ba1b-4330-9ca8-4a677f42b70b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:10.904115 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3ceb4415-ba1b-4330-9ca8-4a677f42b70b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:10.904475 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3ceb4415-ba1b-4330-9ca8-4a677f42b70b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:10.933003 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3ceb4415-ba1b-4330-9ca8-4a677f42b70b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:04:11.288582 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3ceb4415-ba1b-4330-9ca8-4a677f42b70b tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 204 len: 0 microversion: 2.1 time: 0.402605 Jul 28 04:04:11.289927 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 346/713] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:04:10 2022] DELETE /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:04:11.302611 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-03311e3c-e055-4609-8721-357e241976a9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:11.303623 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-03311e3c-e055-4609-8721-357e241976a9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:11.315269 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-03311e3c-e055-4609-8721-357e241976a9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:11.316125 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-03311e3c-e055-4609-8721-357e241976a9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:11.317584 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-03311e3c-e055-4609-8721-357e241976a9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:11.318361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-03311e3c-e055-4609-8721-357e241976a9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:11.360029 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=100 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:11.499184 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-03311e3c-e055-4609-8721-357e241976a9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:11.507120 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-03311e3c-e055-4609-8721-357e241976a9 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.211744 Jul 28 04:04:11.507756 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 368/714] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:11 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:12.531040 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5e2f2b02-bc34-4c36-bdb6-270ea6f23333 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:12.531749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5e2f2b02-bc34-4c36-bdb6-270ea6f23333 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:12.538684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e2f2b02-bc34-4c36-bdb6-270ea6f23333 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:12.539133 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e2f2b02-bc34-4c36-bdb6-270ea6f23333 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:12.541093 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e2f2b02-bc34-4c36-bdb6-270ea6f23333 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:12.541543 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5e2f2b02-bc34-4c36-bdb6-270ea6f23333 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:12.696850 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5e2f2b02-bc34-4c36-bdb6-270ea6f23333 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:12.709034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5e2f2b02-bc34-4c36-bdb6-270ea6f23333 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.182531 Jul 28 04:04:12.709672 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 347/715] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:12 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:13.740330 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1e960901-4c88-458a-9827-6f8fff382e41 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:13.740941 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1e960901-4c88-458a-9827-6f8fff382e41 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:13.748786 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1e960901-4c88-458a-9827-6f8fff382e41 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:13.749244 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1e960901-4c88-458a-9827-6f8fff382e41 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:13.750047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1e960901-4c88-458a-9827-6f8fff382e41 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:13.750498 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1e960901-4c88-458a-9827-6f8fff382e41 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:13.906254 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1e960901-4c88-458a-9827-6f8fff382e41 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:13.920600 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1e960901-4c88-458a-9827-6f8fff382e41 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.184046 Jul 28 04:04:13.921691 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 369/716] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:13 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:14.957415 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e67817db-c60f-4963-9344-c341ab93acf7 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:14.958049 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e67817db-c60f-4963-9344-c341ab93acf7 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:14.966405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e67817db-c60f-4963-9344-c341ab93acf7 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.966868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e67817db-c60f-4963-9344-c341ab93acf7 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:14.967681 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e67817db-c60f-4963-9344-c341ab93acf7 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.968175 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e67817db-c60f-4963-9344-c341ab93acf7 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:15.225341 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e67817db-c60f-4963-9344-c341ab93acf7 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:15.240424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e67817db-c60f-4963-9344-c341ab93acf7 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1521 microversion: 2.1 time: 0.287098 Jul 28 04:04:15.241506 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 348/717] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:14 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:15.587445 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-5206723d-2f6d-47f7-a86a-335c07a295f4 req-a83502d3-db0d-4fd2-8434-436c0b1bb643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30f5c60-8ee4-4d46-aec9-34dd464d21b9", "name": "network-vif-deleted", "tag": "a308124a-65b2-45a7-b6e2-c3a47f628499"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:15.592724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:15.598363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-5206723d-2f6d-47f7-a86a-335c07a295f4 req-a83502d3-db0d-4fd2-8434-436c0b1bb643 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:15.598806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-5206723d-2f6d-47f7-a86a-335c07a295f4 req-a83502d3-db0d-4fd2-8434-436c0b1bb643 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:15.611868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-5206723d-2f6d-47f7-a86a-335c07a295f4 req-a83502d3-db0d-4fd2-8434-436c0b1bb643 service nova] Creating event network-vif-deleted:a308124a-65b2-45a7-b6e2-c3a47f628499 for instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 on hv-cinder-85127 Jul 28 04:04:15.618315 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-5206723d-2f6d-47f7-a86a-335c07a295f4 req-a83502d3-db0d-4fd2-8434-436c0b1bb643 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035058 Jul 28 04:04:15.619275 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 370/718] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:16.279067 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:16.280053 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:16.288636 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.289163 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:16.290475 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.290962 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:16.329306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.329821 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:16.330291 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lazy-loading 'fault' on Instance uuid a30f5c60-8ee4-4d46-aec9-34dd464d21b9 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:04:16.390125 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4251e84650f047c9a6eb0c3b16b25564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf7f0f7880a435ba552361bcb31ef91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:16.401087 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0486e181-aed0-4020-b204-e6f8aa7a0c54 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 200 len: 1311 microversion: 2.1 time: 0.127036 Jul 28 04:04:16.401809 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 349/719] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:16 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:16.523061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d70da08-b77a-4f6e-a2e8-f6d54e5efe73"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:16.526040 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:16.533481 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.533930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:16.534778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.535288 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:16.649515 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Invalid volume: volume 1d70da08-b77a-4f6e-a2e8-f6d54e5efe73 is already attached to instances: 04979300-ed48-49df-85a4-13db2fae199b Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: POST /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments HTTP/1.1 Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 74 Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:04:16.652810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {"volumeAttachment": {"volumeId": "1d70da08-b77a-4f6e-a2e8-f6d54e5efe73"}} Jul 28 04:04:16.654390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Invalid volume: volume 1d70da08-b77a-4f6e-a2e8-f6d54e5efe73 is already attached to instances: 04979300-ed48-49df-85a4-13db2fae199b Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'server_id': '04979300-ed48-49df-85a4-13db2fae199b', 'body': {'volumeAttachment': {'volumeId': '1d70da08-b77a-4f6e-a2e8-f6d54e5efe73'}}} Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1d70da08-b77a-4f6e-a2e8-f6d54e5efe73 is already attached to instances: 04979300-ed48-49df-85a4-13db2fae199b Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:16.655272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1d70da08-b77a-4f6e-a2e8-f6d54e5efe73 is already attached to instances: 04979300-ed48-49df-85a4-13db2fae199b Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:16.659271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:16.660974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:16.660974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:16.660974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:16.660974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1d70da08-b77a-4f6e-a2e8-f6d54e5efe73 is already attached to instances: 04979300-ed48-49df-85a4-13db2fae199b Jul 28 04:04:16.660974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:16.660974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 400 to user: Invalid volume: volume 1d70da08-b77a-4f6e-a2e8-f6d54e5efe73 is already attached to instances: 04979300-ed48-49df-85a4-13db2fae199b {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:16.660974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5c06164f-2eb9-444a-a1ba-e82e25897422 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136893 Jul 28 04:04:16.660974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 371/720] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:04:16 2022] POST /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments => generated 174 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:04:16.736932 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-77725d4b-e411-4671-afd2-cd78536a5203 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:16.737763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-77725d4b-e411-4671-afd2-cd78536a5203 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:16.746236 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-77725d4b-e411-4671-afd2-cd78536a5203 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.746829 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-77725d4b-e411-4671-afd2-cd78536a5203 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:16.747883 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-77725d4b-e411-4671-afd2-cd78536a5203 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.748995 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-77725d4b-e411-4671-afd2-cd78536a5203 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:16.855537 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-77725d4b-e411-4671-afd2-cd78536a5203 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lazy-loading 'services' on Instance uuid 04979300-ed48-49df-85a4-13db2fae199b {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:04:17.237285 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-77725d4b-e411-4671-afd2-cd78536a5203 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments/1d70da08-b77a-4f6e-a2e8-f6d54e5efe73" status: 202 len: 0 microversion: 2.1 time: 0.504857 Jul 28 04:04:17.238466 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 350/721] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:04:16 2022] DELETE /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments/1d70da08-b77a-4f6e-a2e8-f6d54e5efe73 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:04:17.253303 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6c3d207b-de8d-4c27-8d24-16a1d3cc97ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:17.257430 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6c3d207b-de8d-4c27-8d24-16a1d3cc97ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:17.270238 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c3d207b-de8d-4c27-8d24-16a1d3cc97ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.270964 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c3d207b-de8d-4c27-8d24-16a1d3cc97ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.272447 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c3d207b-de8d-4c27-8d24-16a1d3cc97ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.273161 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6c3d207b-de8d-4c27-8d24-16a1d3cc97ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.332203 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6c3d207b-de8d-4c27-8d24-16a1d3cc97ce tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086401 Jul 28 04:04:17.333490 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 372/722] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:04:17 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:17.431344 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:17.432591 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] [instance: a30f5c60-8ee4-4d46-aec9-34dd464d21b9] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:17.445396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.445396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.445396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.445396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.468580 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] HTTP exception thrown: Instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 could not be found. Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Request method failure captured: Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 HTTP/1.1 Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmKWLvqHiajw7Vtw-f2vvp_0YIjU3hSWiY17ioucOls7t40OrsIG6OSQelvM8vSidvlTrUkQl_D2V_jlVb0xPoWv0cI31HO1ossk5jJ2gT7TKd33Bz9cKC_3eCS5JpW3XRsx57me7iAOdWTxirrq9O4DR5qeUqvuAN28zh0ABaN-l0 Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:04:17.470628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8bf7f0f7880a435ba552361bcb31ef91", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8bf7f0f7880a435ba552361bcb31ef91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8bf7f0f7880a435ba552361bcb31ef91"}]}] Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 8bf7f0f7880a435ba552361bcb31ef91 Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-954871407 Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 4251e84650f047c9a6eb0c3b16b25564 Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-ServerRescueNegativeTestJSON-954871407-project Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 could not be found. Jul 28 04:04:17.472817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': 'a30f5c60-8ee4-4d46-aec9-34dd464d21b9'} Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 could not be found. Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:17.474439 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 could not be found. Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 could not be found. Jul 28 04:04:17.478138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:04:17.480404 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] Returning 404 to user: Instance a30f5c60-8ee4-4d46-aec9-34dd464d21b9 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:17.480404 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-89d6bc6f-9b81-476b-bd92-3a17f14b2025 tempest-ServerRescueNegativeTestJSON-954871407 tempest-ServerRescueNegativeTestJSON-954871407-project] 10.222.0.66 "GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9" status: 404 len: 111 microversion: 2.1 time: 0.047388 Jul 28 04:04:17.480404 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 351/723] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:17 2022] GET /compute/v2.1/servers/a30f5c60-8ee4-4d46-aec9-34dd464d21b9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:04:18.352751 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-376891cf-0dc8-491b-b9bc-e4fc12c4bdd6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:18.356698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-376891cf-0dc8-491b-b9bc-e4fc12c4bdd6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:18.369906 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-376891cf-0dc8-491b-b9bc-e4fc12c4bdd6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:18.370521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-376891cf-0dc8-491b-b9bc-e4fc12c4bdd6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:18.371536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-376891cf-0dc8-491b-b9bc-e4fc12c4bdd6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:18.372533 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-376891cf-0dc8-491b-b9bc-e4fc12c4bdd6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:18.434305 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-376891cf-0dc8-491b-b9bc-e4fc12c4bdd6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085603 Jul 28 04:04:18.434305 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 373/724] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:04:18 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:19.451831 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d1eb7296-ece6-470f-ba62-a90b8c7e9c6c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:19.456998 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d1eb7296-ece6-470f-ba62-a90b8c7e9c6c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:19.468207 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d1eb7296-ece6-470f-ba62-a90b8c7e9c6c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:19.469002 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d1eb7296-ece6-470f-ba62-a90b8c7e9c6c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:19.470431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d1eb7296-ece6-470f-ba62-a90b8c7e9c6c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:19.471225 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d1eb7296-ece6-470f-ba62-a90b8c7e9c6c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:19.530783 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d1eb7296-ece6-470f-ba62-a90b8c7e9c6c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085374 Jul 28 04:04:19.531287 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 352/725] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:04:19 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:04:19.654108 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-47f2d2b3-81a4-4ff9-a871-8fdfe8078478 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:19.664317 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-47f2d2b3-81a4-4ff9-a871-8fdfe8078478 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:19.667452 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-47f2d2b3-81a4-4ff9-a871-8fdfe8078478 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:19.668315 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-47f2d2b3-81a4-4ff9-a871-8fdfe8078478 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:19.669796 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-47f2d2b3-81a4-4ff9-a871-8fdfe8078478 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:19.670641 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-47f2d2b3-81a4-4ff9-a871-8fdfe8078478 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:19.705166 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-47f2d2b3-81a4-4ff9-a871-8fdfe8078478 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:04:20.047509 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-47f2d2b3-81a4-4ff9-a871-8fdfe8078478 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 204 len: 0 microversion: 2.1 time: 0.399604 Jul 28 04:04:20.056317 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 374/726] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:04:19 2022] DELETE /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:04:20.060501 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-eb926de0-d5ea-4b3c-9d48-e381ff800dc6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:20.061424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-eb926de0-d5ea-4b3c-9d48-e381ff800dc6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:20.068851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-eb926de0-d5ea-4b3c-9d48-e381ff800dc6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.069627 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-eb926de0-d5ea-4b3c-9d48-e381ff800dc6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.071242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-eb926de0-d5ea-4b3c-9d48-e381ff800dc6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.072000 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-eb926de0-d5ea-4b3c-9d48-e381ff800dc6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.495569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-eb926de0-d5ea-4b3c-9d48-e381ff800dc6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:20.510225 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-eb926de0-d5ea-4b3c-9d48-e381ff800dc6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1682 microversion: 2.1 time: 0.453043 Jul 28 04:04:20.511138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 353/727] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:20 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1682 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:21.547606 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-35a4f758-4b90-43a1-bb44-ede4491bd566 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:21.548439 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-35a4f758-4b90-43a1-bb44-ede4491bd566 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:21.557124 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-35a4f758-4b90-43a1-bb44-ede4491bd566 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:21.557713 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-35a4f758-4b90-43a1-bb44-ede4491bd566 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:21.558602 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-35a4f758-4b90-43a1-bb44-ede4491bd566 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:21.559125 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-35a4f758-4b90-43a1-bb44-ede4491bd566 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:21.743342 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-35a4f758-4b90-43a1-bb44-ede4491bd566 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:21.757905 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-35a4f758-4b90-43a1-bb44-ede4491bd566 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1682 microversion: 2.1 time: 0.214605 Jul 28 04:04:21.758847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 375/728] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:21 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:22.788162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b4c4c20b-11c6-428b-a1d3-b976db1b777c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:22.789204 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b4c4c20b-11c6-428b-a1d3-b976db1b777c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:22.798793 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b4c4c20b-11c6-428b-a1d3-b976db1b777c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:22.799606 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b4c4c20b-11c6-428b-a1d3-b976db1b777c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:22.800719 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b4c4c20b-11c6-428b-a1d3-b976db1b777c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:22.802139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b4c4c20b-11c6-428b-a1d3-b976db1b777c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:22.831768 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:22.888968 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b4c4c20b-11c6-428b-a1d3-b976db1b777c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:22.903012 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b4c4c20b-11c6-428b-a1d3-b976db1b777c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1615 microversion: 2.1 time: 0.118905 Jul 28 04:04:22.903645 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 354/729] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:22 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1615 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:23.253279 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-64d3ac91-0b0c-47b2-90e8-fb1208df2ea0 req-1990db21-b44c-44bb-8c98-d4258acd153e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04979300-ed48-49df-85a4-13db2fae199b", "name": "network-vif-deleted", "tag": "f5b15cf1-c323-439c-8cf9-2d761c12404a"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:23.288061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-64d3ac91-0b0c-47b2-90e8-fb1208df2ea0 req-1990db21-b44c-44bb-8c98-d4258acd153e service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:23.288858 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-64d3ac91-0b0c-47b2-90e8-fb1208df2ea0 req-1990db21-b44c-44bb-8c98-d4258acd153e service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:23.325645 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-64d3ac91-0b0c-47b2-90e8-fb1208df2ea0 req-1990db21-b44c-44bb-8c98-d4258acd153e service nova] Creating event network-vif-deleted:f5b15cf1-c323-439c-8cf9-2d761c12404a for instance 04979300-ed48-49df-85a4-13db2fae199b on hv-cinder-85127 Jul 28 04:04:23.325645 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-64d3ac91-0b0c-47b2-90e8-fb1208df2ea0 req-1990db21-b44c-44bb-8c98-d4258acd153e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079225 Jul 28 04:04:23.328658 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 376/730] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:23.931587 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:23.933826 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:23.947004 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:23.950229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:23.950229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:23.950229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:24.008978 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:24.009760 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:24.010550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lazy-loading 'fault' on Instance uuid 04979300-ed48-49df-85a4-13db2fae199b {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:04:24.082889 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:24.097844 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3d060014-378e-41c1-8aa8-3edaa919d128 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 200 len: 1332 microversion: 2.1 time: 0.174268 Jul 28 04:04:24.098848 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 355/731] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:23 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 1332 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:25.134863 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:25.135656 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:25.145770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:25.145770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:25.145770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:25.145770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:25.161440 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b HTTP/1.1 Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:04:25.163119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:04:25.164950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '04979300-ed48-49df-85a4-13db2fae199b'} Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:25.165879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:04:25.167341 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:04:25.170311 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:25.170311 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-385c3331-f461-4ff2-9c1b-e32c372b1cec tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 404 len: 111 microversion: 2.1 time: 0.036144 Jul 28 04:04:25.170311 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 377/732] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:25 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:04:25.176918 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5a1415e4-f261-4c8f-b427-f2ea7457a16a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '.version_select at 0x7f5572dcaaf0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:25.264610 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5a1415e4-f261-4c8f-b427-f2ea7457a16a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955297559" status: 202 len: 0 microversion: 2.1 time: 0.094323 Jul 28 04:04:25.265213 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 356/733] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Jul 28 04:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955297559 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:04:26.218739 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1ee26f48-66e2-4f48-8b6a-2955799c9eb6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: .version_select at 0x7f5572d599d0>, body: {"keypair": {"name": "tempest-keypair-2016752909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeIiztU7sFNcbSDhJNYnptu/ipZvwbuFh+zTQbn7YPbr+c8yNA94lq2LdJwy+n70uLrE+hx3vJQoqhFUF5aCX4rFhWlZWhQjRRVRpsKqnfYVlAXtK1igolWTm3Q2qEIhw=="}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:26.237120 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-1ee26f48-66e2-4f48-8b6a-2955799c9eb6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for project f68fb083db524ab59ba49d71ae754ba0. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:04:26.242432 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-1ee26f48-66e2-4f48-8b6a-2955799c9eb6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for user 37b7380889a4411cb57465ab5d33ba75 and project f68fb083db524ab59ba49d71ae754ba0. Resources: {'key_pairs'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:04:26.396247 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1ee26f48-66e2-4f48-8b6a-2955799c9eb6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181799 Jul 28 04:04:26.396986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 378/734] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 04:04:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:28.034862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-339835b9-19c9-4f8b-b00f-43ad8047a55c tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572d7e670>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:28.112657 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-339835b9-19c9-4f8b-b00f-43ad8047a55c tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/3c396d10-7953-4639-ad69-65e57ab0ba42" status: 200 len: 351 microversion: 2.1 time: 0.086262 Jul 28 04:04:28.113811 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 357/735] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:04:28 2022] GET /compute/v2.1/os-volumes/3c396d10-7953-4639-ad69-65e57ab0ba42 => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:29.447271 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-916195156", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cf9021b-c509-4bfd-870b-1ff5c987c7dd"}], "security_groups": [{"name": "tempest-securitygroup--335664290"}], "key_name": "tempest-keypair-2016752909", "user_data": "}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:29.580875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] validate_networks() for [('9cf9021b-c509-4bfd-870b-1ff5c987c7dd', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:04:30.002196 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-07583f42-83ef-463a-9fd7-55cd6c85260e tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572d994c0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:30.089441 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-07583f42-83ef-463a-9fd7-55cd6c85260e tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2017c988-4c4d-4bd8-bf24-2cef92d571f3" status: 200 len: 351 microversion: 2.1 time: 0.092249 Jul 28 04:04:30.090312 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 358/736] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:04:29 2022] GET /compute/v2.1/os-volumes/2017c988-4c4d-4bd8-bf24-2cef92d571f3 => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:30.249435 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:04:30.249864 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:04:30.250340 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:04:30.250921 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:04:30.251340 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:04:30.262963 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:30.263421 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:30.264540 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:30.264998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:30.286918 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for project f68fb083db524ab59ba49d71ae754ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:04:30.294333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Getting quotas for user 37b7380889a4411cb57465ab5d33ba75 and project f68fb083db524ab59ba49d71ae754ba0. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:04:30.312312 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:04:30.315013 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:04:30.451811 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0b6bfed6-c9d9-4441-aa36-4053283e8665 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.010709 Jul 28 04:04:30.464968 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5cc57cca-8e52-4373-821f-d6b1f7a67370 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:30.465251 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5cc57cca-8e52-4373-821f-d6b1f7a67370 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:30.468653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 379/737] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:04:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:04:30.548557 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5cc57cca-8e52-4373-821f-d6b1f7a67370 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:30.563684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5cc57cca-8e52-4373-821f-d6b1f7a67370 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1241 microversion: 2.1 time: 0.103084 Jul 28 04:04:30.565663 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 359/738] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:30 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:31.593127 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a56a6ff5-dc77-4bcd-a9fb-ee8ec7f63256 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:31.593843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a56a6ff5-dc77-4bcd-a9fb-ee8ec7f63256 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:31.656496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a56a6ff5-dc77-4bcd-a9fb-ee8ec7f63256 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:31.669002 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a56a6ff5-dc77-4bcd-a9fb-ee8ec7f63256 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1241 microversion: 2.1 time: 0.079952 Jul 28 04:04:31.673446 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 380/739] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:31 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:31.972154 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1f2683a6-eaf2-45e1-8d0e-301c3865e8c7 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572d90c10>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.026054 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1f2683a6-eaf2-45e1-8d0e-301c3865e8c7 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/fefec3b0-a13e-4da1-9e85-216299c122f6" status: 200 len: 350 microversion: 2.1 time: 0.058174 Jul 28 04:04:32.026707 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 360/740] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:04:31 2022] GET /compute/v2.1/os-volumes/fefec3b0-a13e-4da1-9e85-216299c122f6 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:32.041576 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-19afde6a-9087-468d-bbfa-3a0221de5c57 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572dff670>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.147660 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-19afde6a-9087-468d-bbfa-3a0221de5c57 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.110728 Jul 28 04:04:32.148609 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 381/741] 10.222.0.66 () {58 vars in 1134 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:32.163842 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a7c8c264-3441-4443-96d6-50bf964d5a02 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572d90280>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.255923 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a7c8c264-3441-4443-96d6-50bf964d5a02 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096456 Jul 28 04:04:32.257306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 361/742] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:32.272392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0394808d-bb06-4311-a0b4-009032fa7ce7 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572f2ef70>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.364186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0394808d-bb06-4311-a0b4-009032fa7ce7 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094893 Jul 28 04:04:32.364186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 382/743] 10.222.0.66 () {58 vars in 1134 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:32.378240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b3ca3341-1538-4751-aecc-68bd54d6475d tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572dcaf70>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.473886 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b3ca3341-1538-4751-aecc-68bd54d6475d tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.096869 Jul 28 04:04:32.473886 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 362/744] 10.222.0.66 () {58 vars in 1167 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:32.488611 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-90b24378-5d17-4349-b9d0-75b07e67637e tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572d59dc0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.589374 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-90b24378-5d17-4349-b9d0-75b07e67637e tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.107759 Jul 28 04:04:32.590185 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 383/745] 10.222.0.66 () {58 vars in 1170 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:32.604254 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-aee406f3-916a-4d1b-a266-a63adec8285b tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572d90c10>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.699020 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-aee406f3-916a-4d1b-a266-a63adec8285b tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.098698 Jul 28 04:04:32.700209 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c96a65c6-30f9-4f32-bbaf-3a7320125743 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.700768 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 363/746] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:32.701863 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c96a65c6-30f9-4f32-bbaf-3a7320125743 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:32.713715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c96a65c6-30f9-4f32-bbaf-3a7320125743 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:32.713715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c96a65c6-30f9-4f32-bbaf-3a7320125743 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:32.713715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c96a65c6-30f9-4f32-bbaf-3a7320125743 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:32.713715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c96a65c6-30f9-4f32-bbaf-3a7320125743 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:32.717294 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b0591149-f9ac-498e-b6e8-64fcfd005a50 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f5572e1f940>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.781526 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c96a65c6-30f9-4f32-bbaf-3a7320125743 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:32.790493 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c96a65c6-30f9-4f32-bbaf-3a7320125743 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1237 microversion: 2.1 time: 0.097432 Jul 28 04:04:32.791111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 384/747] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:32.874087 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b0591149-f9ac-498e-b6e8-64fcfd005a50 tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.160979 Jul 28 04:04:32.874882 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 364/748] 10.222.0.66 () {58 vars in 1188 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:32.893733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bbde4822-b15c-42f1-bab4-6fd41e7e2e3b tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] Calling method '.version_select at 0x7f55782f33a0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.993232 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-bbde4822-b15c-42f1-bab4-6fd41e7e2e3b tempest-VolumesTestJSON-910440072 tempest-VolumesTestJSON-910440072-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.106275 Jul 28 04:04:32.994684 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 385/749] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:33.817309 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3cf131d7-cd05-45de-93a0-8867d23b4967 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:33.820685 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3cf131d7-cd05-45de-93a0-8867d23b4967 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:33.828712 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3cf131d7-cd05-45de-93a0-8867d23b4967 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:33.829810 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3cf131d7-cd05-45de-93a0-8867d23b4967 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:33.830653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3cf131d7-cd05-45de-93a0-8867d23b4967 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:33.831089 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3cf131d7-cd05-45de-93a0-8867d23b4967 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:34.226205 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-3cf131d7-cd05-45de-93a0-8867d23b4967 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:34.235627 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3cf131d7-cd05-45de-93a0-8867d23b4967 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1311 microversion: 2.1 time: 0.426372 Jul 28 04:04:34.236504 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 365/750] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:33 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1311 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:35.272365 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1347907b-ea6c-4b76-9eb0-1c95dbca959f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:35.273623 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1347907b-ea6c-4b76-9eb0-1c95dbca959f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:35.286177 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1347907b-ea6c-4b76-9eb0-1c95dbca959f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:35.286885 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1347907b-ea6c-4b76-9eb0-1c95dbca959f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:35.288359 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1347907b-ea6c-4b76-9eb0-1c95dbca959f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:35.289162 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1347907b-ea6c-4b76-9eb0-1c95dbca959f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:35.488443 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1347907b-ea6c-4b76-9eb0-1c95dbca959f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:35.502414 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1347907b-ea6c-4b76-9eb0-1c95dbca959f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1366 microversion: 2.1 time: 0.237633 Jul 28 04:04:35.503043 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 386/751] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:35 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:36.092039 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2f0d5eea-4e99-4cfe-b124-4a0e7be5cbfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:36.092728 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2f0d5eea-4e99-4cfe-b124-4a0e7be5cbfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:36.099646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2f0d5eea-4e99-4cfe-b124-4a0e7be5cbfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:36.100251 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2f0d5eea-4e99-4cfe-b124-4a0e7be5cbfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:36.101068 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2f0d5eea-4e99-4cfe-b124-4a0e7be5cbfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:36.101871 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2f0d5eea-4e99-4cfe-b124-4a0e7be5cbfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:36.131031 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2f0d5eea-4e99-4cfe-b124-4a0e7be5cbfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/ips" status: 200 len: 151 microversion: 2.20 time: 0.361722 Jul 28 04:04:36.131625 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 366/752] 10.222.0.66 () {60 vars in 1289 bytes} [Thu Jul 28 04:04:35 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/ips => generated 151 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:04:36.383393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-c2cca77d-5152-4742-b002-d0a56953d586 req-6d48f850-f675-497c-912b-2619f6288b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2fa4aca-3faa-4e71-930d-e9070e320b36", "tag": "2b8528eb-bc69-4fed-a16b-cf002901bbcd"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:36.404026 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-c2cca77d-5152-4742-b002-d0a56953d586 req-6d48f850-f675-497c-912b-2619f6288b60 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:36.406265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-c2cca77d-5152-4742-b002-d0a56953d586 req-6d48f850-f675-497c-912b-2619f6288b60 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:36.428983 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-c2cca77d-5152-4742-b002-d0a56953d586 req-6d48f850-f675-497c-912b-2619f6288b60 service nova] Creating event network-changed:2b8528eb-bc69-4fed-a16b-cf002901bbcd for instance f2fa4aca-3faa-4e71-930d-e9070e320b36 on hv-cinder-85127 Jul 28 04:04:36.439343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-c2cca77d-5152-4742-b002-d0a56953d586 req-6d48f850-f675-497c-912b-2619f6288b60 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195323 Jul 28 04:04:36.441272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 387/753] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:36.526762 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5c476759-ba5d-4748-aa2a-bcea3e80200b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:36.528962 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5c476759-ba5d-4748-aa2a-bcea3e80200b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:36.542596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5c476759-ba5d-4748-aa2a-bcea3e80200b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:36.543372 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5c476759-ba5d-4748-aa2a-bcea3e80200b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:36.544401 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5c476759-ba5d-4748-aa2a-bcea3e80200b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:36.544975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5c476759-ba5d-4748-aa2a-bcea3e80200b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:36.832016 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5c476759-ba5d-4748-aa2a-bcea3e80200b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:36.842162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5c476759-ba5d-4748-aa2a-bcea3e80200b tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1366 microversion: 2.1 time: 0.320050 Jul 28 04:04:36.842777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 367/754] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:36 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:37.880830 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-42d0a000-4169-4500-a59b-a5eacfe3ed72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:37.882100 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-42d0a000-4169-4500-a59b-a5eacfe3ed72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:37.899857 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-42d0a000-4169-4500-a59b-a5eacfe3ed72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:37.900843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-42d0a000-4169-4500-a59b-a5eacfe3ed72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:37.902328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-42d0a000-4169-4500-a59b-a5eacfe3ed72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:37.903117 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-42d0a000-4169-4500-a59b-a5eacfe3ed72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:38.141591 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-42d0a000-4169-4500-a59b-a5eacfe3ed72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:38.158063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-42d0a000-4169-4500-a59b-a5eacfe3ed72 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1366 microversion: 2.1 time: 0.286102 Jul 28 04:04:38.172276 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 388/755] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:37 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:38.599009 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-388225ec-df42-4fdf-aee6-662801992104 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:38.600109 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-388225ec-df42-4fdf-aee6-662801992104 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:38.608650 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-388225ec-df42-4fdf-aee6-662801992104 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:38.609193 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-388225ec-df42-4fdf-aee6-662801992104 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:38.610580 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-388225ec-df42-4fdf-aee6-662801992104 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:38.610988 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-388225ec-df42-4fdf-aee6-662801992104 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:38.640465 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-388225ec-df42-4fdf-aee6-662801992104 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lazy-loading 'flavor' on Instance uuid 29710033-f00f-435c-8485-9dd60d728f27 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:04:39.191344 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5bd6f184-6b79-4a03-8daa-c0e3e553973e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:39.191943 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5bd6f184-6b79-4a03-8daa-c0e3e553973e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:39.199456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bd6f184-6b79-4a03-8daa-c0e3e553973e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:39.199918 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bd6f184-6b79-4a03-8daa-c0e3e553973e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:39.200733 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bd6f184-6b79-4a03-8daa-c0e3e553973e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:39.201179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bd6f184-6b79-4a03-8daa-c0e3e553973e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:39.375364 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-388225ec-df42-4fdf-aee6-662801992104 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/action" status: 202 len: 0 microversion: 2.20 time: 0.779891 Jul 28 04:04:39.376355 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 368/756] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Jul 28 04:04:38 2022] POST /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/action => generated 0 bytes in 782 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:04:39.386336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:39.387227 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:39.396178 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:39.396633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:39.397643 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:39.398093 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:39.411055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5bd6f184-6b79-4a03-8daa-c0e3e553973e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:39.422265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5bd6f184-6b79-4a03-8daa-c0e3e553973e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1366 microversion: 2.1 time: 0.234483 Jul 28 04:04:39.422930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 389/757] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:39 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:39.583709 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:39.594335 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:39.595898 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:39.597178 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0ec75396-a941-4dae-a388-c1e102135483 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.216129 Jul 28 04:04:39.597767 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 369/758] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:39 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:40.451872 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1ceb8f43-7f71-444b-b74f-c0c2be18a7fa tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:40.452716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1ceb8f43-7f71-444b-b74f-c0c2be18a7fa tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:40.455209 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:40.461111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1ceb8f43-7f71-444b-b74f-c0c2be18a7fa tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:40.461707 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1ceb8f43-7f71-444b-b74f-c0c2be18a7fa tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:40.462634 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1ceb8f43-7f71-444b-b74f-c0c2be18a7fa tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:40.463087 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1ceb8f43-7f71-444b-b74f-c0c2be18a7fa tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:40.624661 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:40.626842 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:40.633901 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:40.655736 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:40.655736 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:40.655736 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:40.655736 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:40.709928 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1ceb8f43-7f71-444b-b74f-c0c2be18a7fa tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:40.720246 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1ceb8f43-7f71-444b-b74f-c0c2be18a7fa tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1366 microversion: 2.1 time: 0.272837 Jul 28 04:04:40.729009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 390/759] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:40 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:40.909118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:40.933475 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:40.935487 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:40.937448 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9b3bbc12-c283-4982-93a0-c74d85ecdaed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.320837 Jul 28 04:04:40.938320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 370/760] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:40 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:41.745607 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-45c9bf31-24f6-4834-ac09-2cb5d3ea414f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:41.746713 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-45c9bf31-24f6-4834-ac09-2cb5d3ea414f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:41.750890 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=12 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:41.760261 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-45c9bf31-24f6-4834-ac09-2cb5d3ea414f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:41.761078 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-45c9bf31-24f6-4834-ac09-2cb5d3ea414f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:41.762534 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-45c9bf31-24f6-4834-ac09-2cb5d3ea414f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:41.763339 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-45c9bf31-24f6-4834-ac09-2cb5d3ea414f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:41.773334 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:41.969837 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:41.971202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:41.977914 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:41.984922 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:41.985742 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:41.986690 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-45c9bf31-24f6-4834-ac09-2cb5d3ea414f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:41.987324 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:41.988152 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:41.996544 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-45c9bf31-24f6-4834-ac09-2cb5d3ea414f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1366 microversion: 2.1 time: 0.257985 Jul 28 04:04:42.003622 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 391/761] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:41 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:42.186551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:42.200738 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:42.210092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:42.213827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-85118fbe-ce59-49e8-95f6-3a374e0e8c61 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.254277 Jul 28 04:04:42.220091 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 371/762] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:41 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:04:42.989876 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-4b12b3f6-4a09-4ce3-b465-3a417ba4d582 req-f62aca9f-1f38-4531-80a8-4401dc307a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fa4aca-3faa-4e71-930d-e9070e320b36", "name": "network-vif-plugged", "status": "completed", "tag": "2b8528eb-bc69-4fed-a16b-cf002901bbcd"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:43.004183 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-4b12b3f6-4a09-4ce3-b465-3a417ba4d582 req-f62aca9f-1f38-4531-80a8-4401dc307a3b service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.004414 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-4b12b3f6-4a09-4ce3-b465-3a417ba4d582 req-f62aca9f-1f38-4531-80a8-4401dc307a3b service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.020041 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-4b12b3f6-4a09-4ce3-b465-3a417ba4d582 req-f62aca9f-1f38-4531-80a8-4401dc307a3b service nova] Creating event network-vif-plugged:2b8528eb-bc69-4fed-a16b-cf002901bbcd for instance f2fa4aca-3faa-4e71-930d-e9070e320b36 on hv-cinder-85127 Jul 28 04:04:43.025752 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-4b12b3f6-4a09-4ce3-b465-3a417ba4d582 req-f62aca9f-1f38-4531-80a8-4401dc307a3b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217633 Jul 28 04:04:43.026363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 392/763] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:43.027908 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-165f733e-6137-4bad-add0-0841b49c37c6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:43.029400 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-165f733e-6137-4bad-add0-0841b49c37c6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:43.046926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-165f733e-6137-4bad-add0-0841b49c37c6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.048532 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-165f733e-6137-4bad-add0-0841b49c37c6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.050126 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-165f733e-6137-4bad-add0-0841b49c37c6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.052778 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-165f733e-6137-4bad-add0-0841b49c37c6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.260253 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:43.260253 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:43.266103 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-165f733e-6137-4bad-add0-0841b49c37c6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:43.272476 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.273221 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.274835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.275862 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.279847 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-165f733e-6137-4bad-add0-0841b49c37c6 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1366 microversion: 2.1 time: 0.264803 Jul 28 04:04:43.281239 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 372/764] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:43 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:43.487875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:43.498785 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:43.500641 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:43.502172 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b82da26a-e711-4179-9dec-5323d5e568e2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.250589 Jul 28 04:04:43.502901 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 393/765] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:43 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:04:44.308566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f4b15cf5-a34f-44de-bb6d-37ad00ff6b82 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:44.309593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f4b15cf5-a34f-44de-bb6d-37ad00ff6b82 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:44.319454 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f4b15cf5-a34f-44de-bb6d-37ad00ff6b82 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:44.320172 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f4b15cf5-a34f-44de-bb6d-37ad00ff6b82 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:44.321648 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f4b15cf5-a34f-44de-bb6d-37ad00ff6b82 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:44.322204 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f4b15cf5-a34f-44de-bb6d-37ad00ff6b82 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:44.529788 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:44.530848 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:44.539859 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f4b15cf5-a34f-44de-bb6d-37ad00ff6b82 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:44.542783 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:44.543240 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:44.544251 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:44.544700 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:44.555695 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f4b15cf5-a34f-44de-bb6d-37ad00ff6b82 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1366 microversion: 2.1 time: 0.251540 Jul 28 04:04:44.557160 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 373/766] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:44 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:44.755909 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:44.767888 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:44.769773 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:44.771646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a1a385d7-d41c-43c2-91ed-df35ed1ac7cc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.248384 Jul 28 04:04:44.772319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 394/767] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:44 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:45.590943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-89fd3dbf-e1ab-4a12-9949-f10a33a04f20 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:45.591786 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-89fd3dbf-e1ab-4a12-9949-f10a33a04f20 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:45.598636 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-89fd3dbf-e1ab-4a12-9949-f10a33a04f20 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.599112 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-89fd3dbf-e1ab-4a12-9949-f10a33a04f20 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.599916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-89fd3dbf-e1ab-4a12-9949-f10a33a04f20 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.600395 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-89fd3dbf-e1ab-4a12-9949-f10a33a04f20 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.744646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-89fd3dbf-e1ab-4a12-9949-f10a33a04f20 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:45.753274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-89fd3dbf-e1ab-4a12-9949-f10a33a04f20 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1557 microversion: 2.1 time: 0.166129 Jul 28 04:04:45.753559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 374/768] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:45 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:45.785340 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-881e7a76-ece0-4ba8-9e0f-90ed4b78e28d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:45.785867 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-881e7a76-ece0-4ba8-9e0f-90ed4b78e28d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:45.793915 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-881e7a76-ece0-4ba8-9e0f-90ed4b78e28d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.794378 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-881e7a76-ece0-4ba8-9e0f-90ed4b78e28d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.795460 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-881e7a76-ece0-4ba8-9e0f-90ed4b78e28d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.795942 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-881e7a76-ece0-4ba8-9e0f-90ed4b78e28d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.816409 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:45.819237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:45.839717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.848630 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.848630 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.848630 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.936576 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-881e7a76-ece0-4ba8-9e0f-90ed4b78e28d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156992 Jul 28 04:04:45.937385 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 395/769] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Jul 28 04:04:45 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:46.095751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:46.116693 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:46.118501 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:46.119736 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-849346c6-fe1a-4cbd-b774-a356fb1e31b5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.311395 Jul 28 04:04:46.120594 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 375/770] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:45 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:46.668641 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e4626793-465c-43e0-9abf-11cdd8788b11 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:46.669799 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e4626793-465c-43e0-9abf-11cdd8788b11 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:46.673543 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:46.685872 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e4626793-465c-43e0-9abf-11cdd8788b11 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:46.686805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e4626793-465c-43e0-9abf-11cdd8788b11 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:46.688494 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e4626793-465c-43e0-9abf-11cdd8788b11 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:46.689216 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e4626793-465c-43e0-9abf-11cdd8788b11 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:46.738368 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e4626793-465c-43e0-9abf-11cdd8788b11 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/ips" status: 200 len: 145 microversion: 2.1 time: 0.077724 Jul 28 04:04:46.739584 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 396/771] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 04:04:46 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/ips => generated 145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:47.151818 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:47.152548 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:47.159766 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:47.160248 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:47.161029 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:47.161467 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:47.367615 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:47.378353 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:47.384843 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:47.384843 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7814f710-392b-4bbf-a376-673349aeae15 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.234356 Jul 28 04:04:47.384843 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 376/772] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:47 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:04:47.521291 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-b1f48cce-d2f7-4bc6-8350-230b24ff41e6 req-a4407259-0c98-4347-b38a-3a582d9f29b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2fa4aca-3faa-4e71-930d-e9070e320b36", "tag": "2b8528eb-bc69-4fed-a16b-cf002901bbcd"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:47.538477 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-b1f48cce-d2f7-4bc6-8350-230b24ff41e6 req-a4407259-0c98-4347-b38a-3a582d9f29b8 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:47.538986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-b1f48cce-d2f7-4bc6-8350-230b24ff41e6 req-a4407259-0c98-4347-b38a-3a582d9f29b8 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:47.556102 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-b1f48cce-d2f7-4bc6-8350-230b24ff41e6 req-a4407259-0c98-4347-b38a-3a582d9f29b8 service nova] Creating event network-changed:2b8528eb-bc69-4fed-a16b-cf002901bbcd for instance f2fa4aca-3faa-4e71-930d-e9070e320b36 on hv-cinder-85127 Jul 28 04:04:47.561642 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-b1f48cce-d2f7-4bc6-8350-230b24ff41e6 req-a4407259-0c98-4347-b38a-3a582d9f29b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306678 Jul 28 04:04:47.562956 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 397/773] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:48.407716 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:48.413349 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:48.422437 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.422921 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.423720 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.424214 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.609924 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:48.612382 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:48.621836 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:48.623890 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:48.631501 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ac985c3b-f3d2-4609-a662-7ce771e4f81e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.223083 Jul 28 04:04:48.631501 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 377/774] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:48 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:48.735763 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2ee8a47a-715e-42fa-8a18-ecb692b466de tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41499204-f58d-4a81-82f9-32d5ce388ca9"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:48.738383 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2ee8a47a-715e-42fa-8a18-ecb692b466de tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:48.746456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2ee8a47a-715e-42fa-8a18-ecb692b466de tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.747016 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2ee8a47a-715e-42fa-8a18-ecb692b466de tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.747902 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2ee8a47a-715e-42fa-8a18-ecb692b466de tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.748743 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2ee8a47a-715e-42fa-8a18-ecb692b466de tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:49.670796 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:49.676125 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:49.679732 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:49.680358 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:49.681380 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:49.682004 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:49.860050 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:49.870424 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:49.873705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:49.873705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9483bfbe-86c1-498a-a5df-30ecadf3921c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.207380 Jul 28 04:04:49.873997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 378/775] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:49 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:04:50.179638 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2ee8a47a-715e-42fa-8a18-ecb692b466de tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.448105 Jul 28 04:04:50.190939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 398/776] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:04:48 2022] POST /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments => generated 194 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:50.898262 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:50.898982 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:50.907693 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:50.908187 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:50.909006 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:50.909465 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:51.185819 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:51.195056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:51.196659 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:51.202459 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2c1d4b04-572e-44d2-96e6-709d7c771be2 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1745 microversion: 2.20 time: 0.304192 Jul 28 04:04:51.202459 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 379/777] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:50 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1745 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:52.222984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:52.225037 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:52.233544 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:52.234627 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:52.235433 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:52.235902 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:52.385448 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:52.394179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:52.396423 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:52.397136 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d26b2986-9b72-4471-b0ed-7e94eb5bd1ab tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1745 microversion: 2.20 time: 0.178960 Jul 28 04:04:52.397706 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 399/778] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:52 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:53.422262 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:53.423230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:53.429921 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:53.430978 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:53.431866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:53.433160 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:53.586592 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:53.595713 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:53.597642 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:53.605766 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0da6f7d8-f551-49c0-8ad9-4b698f9d977c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.181384 Jul 28 04:04:53.605766 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 380/779] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:53 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:04:54.624763 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:54.626029 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:54.633337 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:54.634066 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:54.634869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:54.635485 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:54.803938 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:54.816697 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:54.821775 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:54.821775 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c78660a8-f74e-417a-a8df-c298c38038f0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.200599 Jul 28 04:04:54.821775 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 400/780] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:54 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:54.889357 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-4842dc88-47ec-490a-b3ff-916ca4c2f3a3 req-536a8cac-99b0-4fb1-89c7-5645dc885d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29710033-f00f-435c-8485-9dd60d728f27", "name": "network-vif-plugged", "status": "completed", "tag": "de721302-c218-45d7-87a1-d79d5e51a7e4"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:54.905790 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-4842dc88-47ec-490a-b3ff-916ca4c2f3a3 req-536a8cac-99b0-4fb1-89c7-5645dc885d0a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:54.906322 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-4842dc88-47ec-490a-b3ff-916ca4c2f3a3 req-536a8cac-99b0-4fb1-89c7-5645dc885d0a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:54.919879 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-4842dc88-47ec-490a-b3ff-916ca4c2f3a3 req-536a8cac-99b0-4fb1-89c7-5645dc885d0a service nova] Creating event network-vif-plugged:de721302-c218-45d7-87a1-d79d5e51a7e4 for instance 29710033-f00f-435c-8485-9dd60d728f27 on hv-cinder-85127 Jul 28 04:04:54.926351 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-4842dc88-47ec-490a-b3ff-916ca4c2f3a3 req-536a8cac-99b0-4fb1-89c7-5645dc885d0a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040153 Jul 28 04:04:54.928594 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 381/781] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:55.843983 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:55.845268 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:55.856759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:55.858184 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:55.860393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:55.862614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:56.143272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:56.154475 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:56.156026 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:56.157269 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9d1ba484-425a-4d2c-bccc-4b9c60439fdf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.317670 Jul 28 04:04:56.158314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 401/782] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:55 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:04:57.182287 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:57.183018 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:57.190767 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:57.191258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:57.192092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:57.192536 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:57.458951 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:57.478028 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:57.483016 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:57.486875 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-971fe387-1632-4aa1-acdd-22c5749bfa67 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.306878 Jul 28 04:04:57.488405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 382/783] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:57 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:58.038763 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-542b059c-24ba-42c2-a530-334f365b5d14 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:58.042022 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-542b059c-24ba-42c2-a530-334f365b5d14 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:58.063124 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-542b059c-24ba-42c2-a530-334f365b5d14 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:58.064849 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-542b059c-24ba-42c2-a530-334f365b5d14 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:58.065537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-542b059c-24ba-42c2-a530-334f365b5d14 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:58.067344 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-542b059c-24ba-42c2-a530-334f365b5d14 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:58.117447 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-542b059c-24ba-42c2-a530-334f365b5d14 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083637 Jul 28 04:04:58.125224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 402/784] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:04:58 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:58.130550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e68a89a4-0690-4784-8f1a-21417bf591df tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:58.131117 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e68a89a4-0690-4784-8f1a-21417bf591df tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:58.139159 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e68a89a4-0690-4784-8f1a-21417bf591df tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:58.139880 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e68a89a4-0690-4784-8f1a-21417bf591df tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:58.140907 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e68a89a4-0690-4784-8f1a-21417bf591df tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:58.141596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e68a89a4-0690-4784-8f1a-21417bf591df tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:58.179180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e68a89a4-0690-4784-8f1a-21417bf591df tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/41499204-f58d-4a81-82f9-32d5ce388ca9" status: 200 len: 194 microversion: 2.1 time: 0.052846 Jul 28 04:04:58.181106 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 383/785] 10.222.0.66 () {58 vars in 1413 bytes} [Thu Jul 28 04:04:58 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/41499204-f58d-4a81-82f9-32d5ce388ca9 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:58.511812 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:58.512540 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:58.525710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:58.526169 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:58.526969 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:58.527415 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:58.727705 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:58.738342 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:58.740328 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:58.741922 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-cea7d2c5-15d2-445f-b6ea-345531d4a936 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.234801 Jul 28 04:04:58.749560 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 403/786] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:58 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:04:59.771792 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:59.774145 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:59.787730 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:59.788919 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:59.791227 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:59.792107 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:00.003891 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:00.031667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:00.033232 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:00.049804 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5b7607f3-ea88-4ce0-bc17-cdeed106672d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.279832 Jul 28 04:05:00.049804 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 384/787] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:04:59 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:00.112138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f36c483b-1de4-4993-b118-cc3d55f61c86 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d273853e-8244-49b6-90de-d164e71964a4"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:00.115020 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f36c483b-1de4-4993-b118-cc3d55f61c86 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:00.124537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f36c483b-1de4-4993-b118-cc3d55f61c86 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:00.124537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f36c483b-1de4-4993-b118-cc3d55f61c86 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:00.124537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f36c483b-1de4-4993-b118-cc3d55f61c86 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:00.124537 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f36c483b-1de4-4993-b118-cc3d55f61c86 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:01.067085 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:01.067616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:01.080139 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:01.081698 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:01.089548 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:01.090024 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:01.438352 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:01.460677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:01.466070 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:01.469575 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7a8627f6-b149-4964-818f-b73446983555 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.406043 Jul 28 04:05:01.484004 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 385/788] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:01 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:01.504352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f36c483b-1de4-4993-b118-cc3d55f61c86 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "POST /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.397896 Jul 28 04:05:01.504951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 404/789] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:05:00 2022] POST /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments => generated 194 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:02.512531 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:02.513695 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:02.526553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:02.527761 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:02.529427 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:02.530468 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:02.839167 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:02.855215 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:02.858753 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:02.861123 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-bb9776ac-8181-4666-ac0b-1483b6702369 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.356612 Jul 28 04:05:02.876595 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 386/790] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:02 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:03.911048 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:03.911928 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:03.938738 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:03.939647 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:03.942147 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:03.943167 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:04.190129 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:04.200770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:04.201742 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:04.202983 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-51eca00c-109d-4912-b846-286ff7aa2925 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.304548 Jul 28 04:05:04.203576 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 405/791] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:03 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:05.234992 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:05.237168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:05.250001 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:05.251134 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:05.252506 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:05.253550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:05.520486 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:05.529773 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:05.531387 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:05.532675 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9115e782-fecd-49d0-84f8-6f97534c45d7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.305894 Jul 28 04:05:05.533270 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 387/792] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:05 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:06.566100 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:06.566710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:06.573529 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:06.574024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:06.574828 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:06.575278 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:06.742327 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:06.755005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:06.765984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:06.765984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ff24ad03-f77a-4d6b-ae03-b77b74912d65 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1740 microversion: 2.20 time: 0.196999 Jul 28 04:05:06.765984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 406/793] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:06 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:07.784660 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:07.785306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:07.792134 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:07.792623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:07.793397 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:07.793832 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:07.938345 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:07.950986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:07.952594 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:07.953803 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-dc8882a8-f6c9-4206-b85c-9e57743005a7 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1722 microversion: 2.20 time: 0.173173 Jul 28 04:05:07.954410 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 388/794] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:07 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:08.982112 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:08.983232 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:08.994504 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.995919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:08.997087 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.997589 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:09.001097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:09.147287 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:09.156756 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:09.158882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:09.160296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-811e37cd-17a0-4ab2-8e52-13f388392cfb tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1722 microversion: 2.20 time: 0.186275 Jul 28 04:05:09.160867 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 407/795] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:08 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:10.185911 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:10.185911 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:10.193313 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:10.194761 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:10.194761 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:10.195046 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:10.411414 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:10.424677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:10.426447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:10.427659 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0a54cd59-3d65-4dfc-97bb-fffc470679bf tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1725 microversion: 2.20 time: 0.246498 Jul 28 04:05:10.428251 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 389/796] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:10 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:10.454273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-59e3ed5e-e97a-4b3c-bf26-bbd440ce5df5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff13d60d-241c-4c3c-a3b3-81234d6411f4"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:10.454820 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-59e3ed5e-e97a-4b3c-bf26-bbd440ce5df5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:10.462463 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59e3ed5e-e97a-4b3c-bf26-bbd440ce5df5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:10.462922 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59e3ed5e-e97a-4b3c-bf26-bbd440ce5df5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:10.463705 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59e3ed5e-e97a-4b3c-bf26-bbd440ce5df5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:10.464182 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-59e3ed5e-e97a-4b3c-bf26-bbd440ce5df5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:10.944375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-2d879d67-6547-4208-8999-1073c1968320 req-7124be49-6e68-424a-a99b-3145e68f0977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29710033-f00f-435c-8485-9dd60d728f27", "name": "network-vif-unplugged", "status": "completed", "tag": "de721302-c218-45d7-87a1-d79d5e51a7e4"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:10.960186 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-2d879d67-6547-4208-8999-1073c1968320 req-7124be49-6e68-424a-a99b-3145e68f0977 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:10.960891 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-2d879d67-6547-4208-8999-1073c1968320 req-7124be49-6e68-424a-a99b-3145e68f0977 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:10.975384 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.compute.server_external_events [req-2d879d67-6547-4208-8999-1073c1968320 req-7124be49-6e68-424a-a99b-3145e68f0977 service nova] Unable to find a host for instance 29710033-f00f-435c-8485-9dd60d728f27. Dropping event network-vif-unplugged {{(pid=135704) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 04:05:10.976383 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-2d879d67-6547-4208-8999-1073c1968320 req-7124be49-6e68-424a-a99b-3145e68f0977 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036608 Jul 28 04:05:10.977613 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 390/797] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 04:05:11.486956 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-23085100-b505-4e93-b42b-8d56f9817432 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:11.489151 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-23085100-b505-4e93-b42b-8d56f9817432 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:11.496083 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-23085100-b505-4e93-b42b-8d56f9817432 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.501190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-23085100-b505-4e93-b42b-8d56f9817432 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.501190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-23085100-b505-4e93-b42b-8d56f9817432 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.501190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-23085100-b505-4e93-b42b-8d56f9817432 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.529842 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-23085100-b505-4e93-b42b-8d56f9817432 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046742 Jul 28 04:05:11.530422 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 391/798] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:11 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:11.672571 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-30b9266a-aefa-4c01-abf1-4cf9633382a4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:11.673387 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-30b9266a-aefa-4c01-abf1-4cf9633382a4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:11.684062 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30b9266a-aefa-4c01-abf1-4cf9633382a4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.685276 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30b9266a-aefa-4c01-abf1-4cf9633382a4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.686036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30b9266a-aefa-4c01-abf1-4cf9633382a4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.686653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-30b9266a-aefa-4c01-abf1-4cf9633382a4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.737468 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-59e3ed5e-e97a-4b3c-bf26-bbd440ce5df5 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.288845 Jul 28 04:05:11.740085 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 408/799] 10.222.0.66 () {62 vars in 1364 bytes} [Thu Jul 28 04:05:10 2022] POST /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/os-volume_attachments => generated 188 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:05:11.746107 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-30b9266a-aefa-4c01-abf1-4cf9633382a4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/41499204-f58d-4a81-82f9-32d5ce388ca9" status: 200 len: 194 microversion: 2.1 time: 0.076717 Jul 28 04:05:11.747084 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 392/800] 10.222.0.66 () {58 vars in 1413 bytes} [Thu Jul 28 04:05:11 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/41499204-f58d-4a81-82f9-32d5ce388ca9 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:11.759795 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-040e364c-2a42-4911-b769-aeb621f096ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:11.760354 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-040e364c-2a42-4911-b769-aeb621f096ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:11.768243 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-040e364c-2a42-4911-b769-aeb621f096ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.768243 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-040e364c-2a42-4911-b769-aeb621f096ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.768243 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-040e364c-2a42-4911-b769-aeb621f096ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.768825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-040e364c-2a42-4911-b769-aeb621f096ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.868779 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-040e364c-2a42-4911-b769-aeb621f096ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lazy-loading 'services' on Instance uuid 70dc9074-c661-48fa-ba87-ef45db17143b {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:11.914054 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9671a143-9195-4dc6-bc66-89a428138709 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:11.914666 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9671a143-9195-4dc6-bc66-89a428138709 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:11.921054 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9671a143-9195-4dc6-bc66-89a428138709 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.921486 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9671a143-9195-4dc6-bc66-89a428138709 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.922617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9671a143-9195-4dc6-bc66-89a428138709 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.923034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9671a143-9195-4dc6-bc66-89a428138709 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.150464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-040e364c-2a42-4911-b769-aeb621f096ae tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "DELETE /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/41499204-f58d-4a81-82f9-32d5ce388ca9" status: 202 len: 0 microversion: 2.1 time: 0.395537 Jul 28 04:05:12.151059 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 409/801] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:05:11 2022] DELETE /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/41499204-f58d-4a81-82f9-32d5ce388ca9 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:05:12.579272 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:12.698623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9671a143-9195-4dc6-bc66-89a428138709 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "DELETE /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/os-volume_attachments/ff13d60d-241c-4c3c-a3b3-81234d6411f4" status: 202 len: 0 microversion: 2.20 time: 0.788242 Jul 28 04:05:12.699409 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 393/802] 10.222.0.66 () {60 vars in 1457 bytes} [Thu Jul 28 04:05:11 2022] DELETE /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/os-volume_attachments/ff13d60d-241c-4c3c-a3b3-81234d6411f4 => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:12.796238 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f7c3a554-fa41-411b-969a-83f08bef9b9e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:12.796939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f7c3a554-fa41-411b-969a-83f08bef9b9e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:12.803907 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f7c3a554-fa41-411b-969a-83f08bef9b9e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.804705 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f7c3a554-fa41-411b-969a-83f08bef9b9e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.806663 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f7c3a554-fa41-411b-969a-83f08bef9b9e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.807464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f7c3a554-fa41-411b-969a-83f08bef9b9e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.878969 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f7c3a554-fa41-411b-969a-83f08bef9b9e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=135703) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 04:05:13.420458 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f7c3a554-fa41-411b-969a-83f08bef9b9e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "POST /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/action" status: 202 len: 0 microversion: 2.20 time: 0.629129 Jul 28 04:05:13.421523 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 410/803] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Jul 28 04:05:12 2022] POST /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:13.432362 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:13.433623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:13.441480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:13.441936 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:13.443009 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:13.443670 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:13.653745 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:13.662975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:13.664648 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:13.665960 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8c5ab431-f0ee-4d05-8e6c-aa98e7ac9f79 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1673 microversion: 2.20 time: 0.239006 Jul 28 04:05:13.682426 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 394/804] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:13 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1673 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:14.370686 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9d1d7cb0-dae2-4519-86c8-48b447983b4a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:14.371323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9d1d7cb0-dae2-4519-86c8-48b447983b4a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:14.379352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d1d7cb0-dae2-4519-86c8-48b447983b4a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.380556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d1d7cb0-dae2-4519-86c8-48b447983b4a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.381546 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d1d7cb0-dae2-4519-86c8-48b447983b4a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.382154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d1d7cb0-dae2-4519-86c8-48b447983b4a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.420702 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9d1d7cb0-dae2-4519-86c8-48b447983b4a tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/d273853e-8244-49b6-90de-d164e71964a4" status: 200 len: 194 microversion: 2.1 time: 0.054140 Jul 28 04:05:14.421319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 411/805] 10.222.0.66 () {58 vars in 1413 bytes} [Thu Jul 28 04:05:14 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/d273853e-8244-49b6-90de-d164e71964a4 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:14.435916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-493f15e2-d1b8-4b8b-a312-71d8347a8357 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:14.436576 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-493f15e2-d1b8-4b8b-a312-71d8347a8357 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:14.438711 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=48 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:14.443719 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-493f15e2-d1b8-4b8b-a312-71d8347a8357 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.448608 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-493f15e2-d1b8-4b8b-a312-71d8347a8357 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.448608 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-493f15e2-d1b8-4b8b-a312-71d8347a8357 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.448608 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-493f15e2-d1b8-4b8b-a312-71d8347a8357 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.559330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-493f15e2-d1b8-4b8b-a312-71d8347a8357 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lazy-loading 'services' on Instance uuid 70dc9074-c661-48fa-ba87-ef45db17143b {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:14.691193 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:14.692217 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:14.699810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.700750 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.701670 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.702180 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.850477 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-493f15e2-d1b8-4b8b-a312-71d8347a8357 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "DELETE /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/d273853e-8244-49b6-90de-d164e71964a4" status: 202 len: 0 microversion: 2.1 time: 0.421581 Jul 28 04:05:14.852283 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 395/806] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:05:14 2022] DELETE /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments/d273853e-8244-49b6-90de-d164e71964a4 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:05:14.965897 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:14.975813 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:14.978237 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:14.979356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0837a6cf-951d-4174-ae09-56cb895bd769 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1673 microversion: 2.20 time: 0.292779 Jul 28 04:05:14.980019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 412/807] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:14 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1673 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:16.006849 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:16.008641 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:16.015570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.016163 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.017327 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.017968 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.104201 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f5eb2c57-e260-4b0e-b81a-e522b40fc034 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:16.106613 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f5eb2c57-e260-4b0e-b81a-e522b40fc034 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:16.121151 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f5eb2c57-e260-4b0e-b81a-e522b40fc034 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.122194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f5eb2c57-e260-4b0e-b81a-e522b40fc034 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.123898 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f5eb2c57-e260-4b0e-b81a-e522b40fc034 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.124865 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f5eb2c57-e260-4b0e-b81a-e522b40fc034 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.172018 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f5eb2c57-e260-4b0e-b81a-e522b40fc034 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073025 Jul 28 04:05:16.172710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 413/808] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:16 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 04:05:16.305594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f31b0fb0-729e-4194-92fa-d28862dc90ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:16.307876 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f31b0fb0-729e-4194-92fa-d28862dc90ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:16.314867 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f31b0fb0-729e-4194-92fa-d28862dc90ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.315326 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f31b0fb0-729e-4194-92fa-d28862dc90ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.319212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f31b0fb0-729e-4194-92fa-d28862dc90ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.319212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f31b0fb0-729e-4194-92fa-d28862dc90ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.348754 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f31b0fb0-729e-4194-92fa-d28862dc90ee tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047291 Jul 28 04:05:16.349319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 414/809] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:16 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 04:05:16.371997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:16.382545 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:16.385034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:16.386595 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4ba007e9-aade-4797-8e64-1ebc1198e07e tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.385278 Jul 28 04:05:16.387289 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 396/810] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:15 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:16.428840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a8faa360-4c98-4a94-babd-24ab25c7fed7 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:16.429322 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a8faa360-4c98-4a94-babd-24ab25c7fed7 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:16.436353 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a8faa360-4c98-4a94-babd-24ab25c7fed7 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.437177 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a8faa360-4c98-4a94-babd-24ab25c7fed7 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.437999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a8faa360-4c98-4a94-babd-24ab25c7fed7 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.438452 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a8faa360-4c98-4a94-babd-24ab25c7fed7 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.467034 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a8faa360-4c98-4a94-babd-24ab25c7fed7 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:05:17.121509 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a8faa360-4c98-4a94-babd-24ab25c7fed7 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "DELETE /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 204 len: 0 microversion: 2.1 time: 0.696332 Jul 28 04:05:17.131067 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 415/811] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:16 2022] DELETE /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:17.135856 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9f302a66-8b8f-45c4-90bb-40d86887cb38 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:17.136706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9f302a66-8b8f-45c4-90bb-40d86887cb38 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:17.147721 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9f302a66-8b8f-45c4-90bb-40d86887cb38 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:17.148513 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9f302a66-8b8f-45c4-90bb-40d86887cb38 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:17.150503 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9f302a66-8b8f-45c4-90bb-40d86887cb38 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:17.151201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9f302a66-8b8f-45c4-90bb-40d86887cb38 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:17.316516 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9f302a66-8b8f-45c4-90bb-40d86887cb38 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:17.326902 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9f302a66-8b8f-45c4-90bb-40d86887cb38 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1672 microversion: 2.1 time: 0.197731 Jul 28 04:05:17.327596 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 397/812] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:17 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:17.413047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:17.413912 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:17.417704 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:17.423205 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:17.423659 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:17.424489 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:17.424926 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:17.609150 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:17.618363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:17.619897 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:17.621158 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9250ede9-8352-4b5c-8e9b-e89d09fe5c5c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.213597 Jul 28 04:05:17.621740 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 416/813] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:17 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:18.348755 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c13808e9-c62b-433d-a584-c88ac7f57bd9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:18.349446 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c13808e9-c62b-433d-a584-c88ac7f57bd9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:18.357193 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c13808e9-c62b-433d-a584-c88ac7f57bd9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:18.357647 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c13808e9-c62b-433d-a584-c88ac7f57bd9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:18.358447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c13808e9-c62b-433d-a584-c88ac7f57bd9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:18.358898 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c13808e9-c62b-433d-a584-c88ac7f57bd9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:18.509748 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c13808e9-c62b-433d-a584-c88ac7f57bd9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:18.518464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c13808e9-c62b-433d-a584-c88ac7f57bd9 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1672 microversion: 2.1 time: 0.173587 Jul 28 04:05:18.519679 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 398/814] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:18 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:18.650625 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:18.652185 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:18.688561 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:18.691379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:18.695675 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:18.698541 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:18.942152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:18.946366 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:18.953601 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:18.955104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:18.956335 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-662bc137-5e7a-4517-8f5a-cdfee11b3246 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.313556 Jul 28 04:05:18.956937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 417/815] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:18 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:19.546896 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1509395d-c178-4e4c-a533-0c441af666eb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:19.557887 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1509395d-c178-4e4c-a533-0c441af666eb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:19.572420 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1509395d-c178-4e4c-a533-0c441af666eb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:19.573336 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1509395d-c178-4e4c-a533-0c441af666eb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:19.574831 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1509395d-c178-4e4c-a533-0c441af666eb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:19.575685 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1509395d-c178-4e4c-a533-0c441af666eb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:19.701981 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d32b166c-e43c-4c9e-af41-c16b6ca3d3c8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:19.704099 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d32b166c-e43c-4c9e-af41-c16b6ca3d3c8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:19.719297 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d32b166c-e43c-4c9e-af41-c16b6ca3d3c8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:19.720955 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d32b166c-e43c-4c9e-af41-c16b6ca3d3c8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:19.722865 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d32b166c-e43c-4c9e-af41-c16b6ca3d3c8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:19.723908 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d32b166c-e43c-4c9e-af41-c16b6ca3d3c8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:19.764192 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d32b166c-e43c-4c9e-af41-c16b6ca3d3c8 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/ips" status: 200 len: 151 microversion: 2.1 time: 0.070438 Jul 28 04:05:19.765800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 418/816] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 04:05:19 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/ips => generated 151 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:19.793024 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1509395d-c178-4e4c-a533-0c441af666eb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:19.806452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1509395d-c178-4e4c-a533-0c441af666eb tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1672 microversion: 2.1 time: 0.266889 Jul 28 04:05:19.809440 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 399/817] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:19 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:19.986838 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:19.987912 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:20.000478 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.001796 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.003380 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.004600 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.276571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:20.286743 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:20.290170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:20.293041 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-92f3bf19-7766-435e-b1ac-33e15e451559 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.314388 Jul 28 04:05:20.303995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 419/818] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:19 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:20.832057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-76389f8a-da5e-4b91-8c46-bbced15fdcb4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:20.833613 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-76389f8a-da5e-4b91-8c46-bbced15fdcb4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:20.843082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76389f8a-da5e-4b91-8c46-bbced15fdcb4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.843824 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76389f8a-da5e-4b91-8c46-bbced15fdcb4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.844881 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76389f8a-da5e-4b91-8c46-bbced15fdcb4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.845497 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76389f8a-da5e-4b91-8c46-bbced15fdcb4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:21.085969 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-76389f8a-da5e-4b91-8c46-bbced15fdcb4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:21.096241 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-76389f8a-da5e-4b91-8c46-bbced15fdcb4 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1672 microversion: 2.1 time: 0.269020 Jul 28 04:05:21.096846 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 400/819] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:20 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:21.323437 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:21.324539 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:21.334505 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:21.335097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:21.336020 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:21.336592 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:21.569787 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:21.590237 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:21.593344 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:21.595436 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d19d5798-5d4e-4d62-b0fa-52c04c45e06f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.279790 Jul 28 04:05:21.602429 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 420/820] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:21 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:22.014463 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5b079f51-359c-4013-9d36-569b7c24743e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23b31177-87e3-40ce-9d18-4c3886a4364c"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:22.017856 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5b079f51-359c-4013-9d36-569b7c24743e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:22.026375 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5b079f51-359c-4013-9d36-569b7c24743e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.026841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5b079f51-359c-4013-9d36-569b7c24743e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:22.028042 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5b079f51-359c-4013-9d36-569b7c24743e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.028680 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5b079f51-359c-4013-9d36-569b7c24743e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:22.118788 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-361a8632-1ed1-47a8-984f-279e65c73ff6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:22.119673 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-361a8632-1ed1-47a8-984f-279e65c73ff6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:22.137320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-361a8632-1ed1-47a8-984f-279e65c73ff6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.137320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-361a8632-1ed1-47a8-984f-279e65c73ff6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:22.141470 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-361a8632-1ed1-47a8-984f-279e65c73ff6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.142322 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-361a8632-1ed1-47a8-984f-279e65c73ff6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:22.330477 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-361a8632-1ed1-47a8-984f-279e65c73ff6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:22.341475 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-361a8632-1ed1-47a8-984f-279e65c73ff6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1672 microversion: 2.1 time: 0.227200 Jul 28 04:05:22.351364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 421/821] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:22 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:22.631284 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:22.632066 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:22.640547 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.641962 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:22.642151 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.642574 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:22.899306 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:22.908959 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:22.910972 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:22.912599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-cd28aef1-a809-4722-9b36-0a8be16a4b2d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.288301 Jul 28 04:05:22.930853 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 422/822] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:22 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:23.362941 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1c70c01d-752b-4ebd-9b91-62a9d8fdc447 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:23.363595 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1c70c01d-752b-4ebd-9b91-62a9d8fdc447 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:23.371517 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c70c01d-752b-4ebd-9b91-62a9d8fdc447 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:23.372273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c70c01d-752b-4ebd-9b91-62a9d8fdc447 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:23.373492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c70c01d-752b-4ebd-9b91-62a9d8fdc447 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:23.374085 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c70c01d-752b-4ebd-9b91-62a9d8fdc447 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:23.585836 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1c70c01d-752b-4ebd-9b91-62a9d8fdc447 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:23.601517 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1c70c01d-752b-4ebd-9b91-62a9d8fdc447 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1672 microversion: 2.1 time: 0.242025 Jul 28 04:05:23.602588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 423/823] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:23 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1672 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:23.938990 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:23.940775 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:23.951883 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:23.952374 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:23.953170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:23.953684 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.201830 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:24.213030 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:24.214882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:24.216364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-38e0a36e-9dee-464f-b316-f0e6738d5c73 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.281410 Jul 28 04:05:24.216991 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 424/824] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:23 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:24.627340 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-17de01dc-d49a-4ec3-a350-a884d2854ba3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:24.628068 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-17de01dc-d49a-4ec3-a350-a884d2854ba3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:24.637605 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-17de01dc-d49a-4ec3-a350-a884d2854ba3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.638099 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-17de01dc-d49a-4ec3-a350-a884d2854ba3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.638859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-17de01dc-d49a-4ec3-a350-a884d2854ba3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.639312 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-17de01dc-d49a-4ec3-a350-a884d2854ba3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.820931 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-17de01dc-d49a-4ec3-a350-a884d2854ba3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:24.841653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-17de01dc-d49a-4ec3-a350-a884d2854ba3 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1672 microversion: 2.1 time: 0.218618 Jul 28 04:05:24.845621 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 425/825] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:24 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1672 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:25.243692 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:25.245565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:25.263502 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.269337 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.269337 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.269337 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.496395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:25.518175 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:25.520435 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:25.521423 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0664b5eb-f6b8-4f94-85d2-fbeb1525e139 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.282378 Jul 28 04:05:25.536599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 426/826] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:25 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:25.874039 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2b884af8-a9c0-4466-88e3-0fc356ba210f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:25.876533 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2b884af8-a9c0-4466-88e3-0fc356ba210f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:25.889684 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2b884af8-a9c0-4466-88e3-0fc356ba210f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.890704 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2b884af8-a9c0-4466-88e3-0fc356ba210f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.892415 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2b884af8-a9c0-4466-88e3-0fc356ba210f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.893265 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2b884af8-a9c0-4466-88e3-0fc356ba210f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.054511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2b884af8-a9c0-4466-88e3-0fc356ba210f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:26.090807 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2b884af8-a9c0-4466-88e3-0fc356ba210f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1605 microversion: 2.1 time: 0.224514 Jul 28 04:05:26.097232 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 427/827] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:25 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:26.284187 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5b079f51-359c-4013-9d36-569b7c24743e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "POST /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.268975 Jul 28 04:05:26.286384 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 401/828] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:05:22 2022] POST /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments => generated 194 bytes in 4277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:26.550638 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:26.558590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:26.585319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.585319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.603255 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.603704 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.664412 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-67ad056b-9c80-4e1d-88ff-28efca1ab90c req-5dd0b3a7-6cd8-4458-bcfb-f86e18539b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dc9074-c661-48fa-ba87-ef45db17143b", "name": "network-vif-deleted", "tag": "03f6d4b3-f03e-4e79-9f11-0cea1b416098"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:26.712410 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-67ad056b-9c80-4e1d-88ff-28efca1ab90c req-5dd0b3a7-6cd8-4458-bcfb-f86e18539b03 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.712410 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-67ad056b-9c80-4e1d-88ff-28efca1ab90c req-5dd0b3a7-6cd8-4458-bcfb-f86e18539b03 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.734154 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-67ad056b-9c80-4e1d-88ff-28efca1ab90c req-5dd0b3a7-6cd8-4458-bcfb-f86e18539b03 service nova] Creating event network-vif-deleted:03f6d4b3-f03e-4e79-9f11-0cea1b416098 for instance 70dc9074-c661-48fa-ba87-ef45db17143b on hv-cinder-85127 Jul 28 04:05:26.745583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-67ad056b-9c80-4e1d-88ff-28efca1ab90c req-5dd0b3a7-6cd8-4458-bcfb-f86e18539b03 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096841 Jul 28 04:05:26.751147 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 402/829] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:26.936923 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:26.952109 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:26.954965 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:26.956619 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b8d0af41-35de-45c0-bfc2-842694caf909 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.413644 Jul 28 04:05:26.958023 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 428/830] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:26 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:27.135841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:27.140551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:27.155031 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.155834 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:27.156688 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.157135 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:27.214569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.215049 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:27.216702 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lazy-loading 'fault' on Instance uuid 70dc9074-c661-48fa-ba87-ef45db17143b {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:27.261595 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:27.271136 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8eebfd12-ddad-4ad0-9140-b6aecc8145ea tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1327 microversion: 2.1 time: 0.141318 Jul 28 04:05:27.287242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 403/831] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:27 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1327 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:27.982562 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:27.983511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:28.003225 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.003225 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.003225 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.003225 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.276518 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:28.284600 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:28.286089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:28.287254 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-10c39d08-8b00-4e7b-93ef-c270c2557d28 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.309796 Jul 28 04:05:28.287868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 429/832] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:27 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:28.295478 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:28.296134 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:28.302763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.316569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.316569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.316569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.340947 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.341399 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.341852 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lazy-loading 'fault' on Instance uuid 70dc9074-c661-48fa-ba87-ef45db17143b {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:28.387129 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f301573dbb914d7a948851cb060d8483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a869e1e00fc4d8d9d4511e34501665f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:28.396525 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-069ed535-dcbc-4083-b614-b1e76b432be6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 200 len: 1327 microversion: 2.1 time: 0.104535 Jul 28 04:05:28.397118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 404/833] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:28 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:28.546393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-68a76995-7d9a-4bdc-b854-dbe178c1d3c7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:28.547474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-68a76995-7d9a-4bdc-b854-dbe178c1d3c7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:28.549824 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-5807a269-ed7e-452d-b501-1b047296e4d8 req-d02cf953-7fa1-4f2f-a192-0805fee6ae1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed19419-f0b9-473d-93cb-fefb8c29d74e", "tag": "68bf49ef-5416-40a1-b99b-f3cd17caa288"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:28.561027 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-68a76995-7d9a-4bdc-b854-dbe178c1d3c7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.561936 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-68a76995-7d9a-4bdc-b854-dbe178c1d3c7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.563797 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-68a76995-7d9a-4bdc-b854-dbe178c1d3c7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.564770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-68a76995-7d9a-4bdc-b854-dbe178c1d3c7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.567265 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-5807a269-ed7e-452d-b501-1b047296e4d8 req-d02cf953-7fa1-4f2f-a192-0805fee6ae1f service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.568042 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-5807a269-ed7e-452d-b501-1b047296e4d8 req-d02cf953-7fa1-4f2f-a192-0805fee6ae1f service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.611240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-5807a269-ed7e-452d-b501-1b047296e4d8 req-d02cf953-7fa1-4f2f-a192-0805fee6ae1f service nova] Creating event network-changed:68bf49ef-5416-40a1-b99b-f3cd17caa288 for instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e on hv-cinder-85127 Jul 28 04:05:28.629827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-68a76995-7d9a-4bdc-b854-dbe178c1d3c7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:05:28.636097 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-5807a269-ed7e-452d-b501-1b047296e4d8 req-d02cf953-7fa1-4f2f-a192-0805fee6ae1f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096170 Jul 28 04:05:28.644104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 405/834] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:28.999678 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-68a76995-7d9a-4bdc-b854-dbe178c1d3c7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 204 len: 0 microversion: 2.1 time: 0.462625 Jul 28 04:05:29.003627 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 430/835] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:28 2022] DELETE /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:29.014675 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f00ce04f-c67f-47a9-8c5b-f99633900fa6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.015978 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f00ce04f-c67f-47a9-8c5b-f99633900fa6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:29.027737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f00ce04f-c67f-47a9-8c5b-f99633900fa6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.028633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f00ce04f-c67f-47a9-8c5b-f99633900fa6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.030057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f00ce04f-c67f-47a9-8c5b-f99633900fa6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.030885 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f00ce04f-c67f-47a9-8c5b-f99633900fa6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.217752 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f00ce04f-c67f-47a9-8c5b-f99633900fa6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:29.228066 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f00ce04f-c67f-47a9-8c5b-f99633900fa6 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.221559 Jul 28 04:05:29.228777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 406/836] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:29 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:29.312365 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.313074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:29.320106 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.320488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.321986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.322556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.420248 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.421105 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:29.428386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.429127 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.429916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.430546 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.447241 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] HTTP exception thrown: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Request method failure captured: Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b HTTP/1.1 Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gl_PM82xQgI6yZLI0aabg0s_CtUzE5TczQ-7KoZjaRn90NY40c-VQaXkVJora5SjgKxsVLO35UUfZ5WW3T65hzKnVGT8GbjlAESmHVtyLMdaAc2c-jv-VNZjhUaadgGN9PVGPefcJyIydX6NLbH9IGAL_wuHgqaJmaEjO_p1NNTYQU Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:05:29.449098 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6a869e1e00fc4d8d9d4511e34501665f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}] Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: f301573dbb914d7a948851cb060d8483 Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:29.451619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '70dc9074-c661-48fa-ba87-ef45db17143b'} Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:29.453785 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:29.456677 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.464797 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Returning 404 to user: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:29.464797 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-58565d61-59fa-4358-9717-5fbfbd51232c tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 404 len: 111 microversion: 2.1 time: 0.036043 Jul 28 04:05:29.464797 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 407/837] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:29 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:05:29.470659 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a3d2311c-afdc-4a45-be63-ab684235b2f6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '.version_select at 0x7f5572d75550>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.472123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:29.482847 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:29.484411 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:29.485656 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-eb6e44c3-10f2-4cee-811d-5d440069fa37 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.177743 Jul 28 04:05:29.486229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 431/838] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:29 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:29.573895 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a3d2311c-afdc-4a45-be63-ab684235b2f6 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-572316035" status: 202 len: 0 microversion: 2.1 time: 0.110589 Jul 28 04:05:29.579777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 408/839] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Jul 28 04:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-572316035 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:05:30.254097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-892dd899-dea0-4655-a1f5-6829734e7bec tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:30.255165 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-892dd899-dea0-4655-a1f5-6829734e7bec tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:30.263817 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-892dd899-dea0-4655-a1f5-6829734e7bec tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:30.264862 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-892dd899-dea0-4655-a1f5-6829734e7bec tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:30.265354 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-892dd899-dea0-4655-a1f5-6829734e7bec tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:30.265810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-892dd899-dea0-4655-a1f5-6829734e7bec tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:30.468334 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-892dd899-dea0-4655-a1f5-6829734e7bec tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:30.477632 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-892dd899-dea0-4655-a1f5-6829734e7bec tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1569 microversion: 2.1 time: 0.230047 Jul 28 04:05:30.478491 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 432/840] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:30 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:30.517870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:30.518599 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:30.527249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:30.527741 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:30.528636 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:30.529273 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:30.928092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:30.943928 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:30.946764 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:30.949030 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d380bd45-36b1-453a-9f55-915b7377bea3 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.437491 Jul 28 04:05:30.950000 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 409/841] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:30 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:31.509835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-248382e7-e8b7-44f3-bb17-b3958b744184 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:31.514263 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-248382e7-e8b7-44f3-bb17-b3958b744184 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:31.530361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-248382e7-e8b7-44f3-bb17-b3958b744184 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.532517 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-248382e7-e8b7-44f3-bb17-b3958b744184 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.534494 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-248382e7-e8b7-44f3-bb17-b3958b744184 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.536242 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-248382e7-e8b7-44f3-bb17-b3958b744184 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.550155 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:31.713961 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-248382e7-e8b7-44f3-bb17-b3958b744184 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:31.725402 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-248382e7-e8b7-44f3-bb17-b3958b744184 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1450 microversion: 2.1 time: 0.226493 Jul 28 04:05:31.726037 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 433/842] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:31 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1450 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:31.859046 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-57323f9e-efcd-4559-a2c2-31c360252279 req-ec7747a9-9fc7-428d-865a-717182e66553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed19419-f0b9-473d-93cb-fefb8c29d74e", "name": "network-vif-deleted", "tag": "68bf49ef-5416-40a1-b99b-f3cd17caa288"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:31.870282 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-57323f9e-efcd-4559-a2c2-31c360252279 req-ec7747a9-9fc7-428d-865a-717182e66553 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.872101 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-57323f9e-efcd-4559-a2c2-31c360252279 req-ec7747a9-9fc7-428d-865a-717182e66553 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.875787 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:31.884620 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-57323f9e-efcd-4559-a2c2-31c360252279 req-ec7747a9-9fc7-428d-865a-717182e66553 service nova] Creating event network-vif-deleted:68bf49ef-5416-40a1-b99b-f3cd17caa288 for instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e on hv-cinder-85127 Jul 28 04:05:31.890008 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-57323f9e-efcd-4559-a2c2-31c360252279 req-ec7747a9-9fc7-428d-865a-717182e66553 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035816 Jul 28 04:05:31.891044 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 410/843] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:31.974861 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:31.975474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:31.983439 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.983895 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.984800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.985246 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.144772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:32.154449 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:32.156320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:32.157570 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5f427db5-3453-44fa-a736-2278a38013fc tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.186753 Jul 28 04:05:32.158151 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 434/844] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:31 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:32.747405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f6195984-079d-41f3-acf3-74603a19fcd7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:32.748467 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f6195984-079d-41f3-acf3-74603a19fcd7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:32.756009 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f6195984-079d-41f3-acf3-74603a19fcd7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.756401 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f6195984-079d-41f3-acf3-74603a19fcd7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.757247 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f6195984-079d-41f3-acf3-74603a19fcd7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.757689 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f6195984-079d-41f3-acf3-74603a19fcd7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.838799 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f6195984-079d-41f3-acf3-74603a19fcd7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efddbdbab2724260a3efd7d01fc39bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e16f8abc2ed4df1b2834b1669b67a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:32.851592 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f6195984-079d-41f3-acf3-74603a19fcd7 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 200 len: 1219 microversion: 2.1 time: 0.108083 Jul 28 04:05:32.852687 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 411/845] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:32 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:33.060784 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-64baea66-27d5-4461-9a35-567de1f66d05 req-39ccd9c2-9987-46e9-9d77-3709190a4eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29710033-f00f-435c-8485-9dd60d728f27", "name": "network-vif-plugged", "status": "completed", "tag": "de721302-c218-45d7-87a1-d79d5e51a7e4"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:33.082235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-64baea66-27d5-4461-9a35-567de1f66d05 req-39ccd9c2-9987-46e9-9d77-3709190a4eb8 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.082915 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-64baea66-27d5-4461-9a35-567de1f66d05 req-39ccd9c2-9987-46e9-9d77-3709190a4eb8 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.098822 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-64baea66-27d5-4461-9a35-567de1f66d05 req-39ccd9c2-9987-46e9-9d77-3709190a4eb8 service nova] Creating event network-vif-plugged:de721302-c218-45d7-87a1-d79d5e51a7e4 for instance 29710033-f00f-435c-8485-9dd60d728f27 on hv-cinder-85127 Jul 28 04:05:33.105120 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-64baea66-27d5-4461-9a35-567de1f66d05 req-39ccd9c2-9987-46e9-9d77-3709190a4eb8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053189 Jul 28 04:05:33.105704 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 435/846] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:33.180841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.181575 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:33.188915 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.189451 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.190313 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.190828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.329417 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:33.338086 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:33.339821 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:33.341088 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-fe130997-c837-430a-8144-a64c5db2ea68 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.164176 Jul 28 04:05:33.344883 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 412/847] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:33 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:33.612128 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.612128 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:33.615793 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.616308 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.617096 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.617542 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.636989 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] HTTP exception thrown: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Request method failure captured: Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: DELETE /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b HTTP/1.1 Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gl_PM82xQgI6yZLI0aabg0s_CtUzE5TczQ-7KoZjaRn90NY40c-VQaXkVJora5SjgKxsVLO35UUfZ5WW3T65hzKnVGT8GbjlAESmHVtyLMdaAc2c-jv-VNZjhUaadgGN9PVGPefcJyIydX6NLbH9IGAL_wuHgqaJmaEjO_p1NNTYQU Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:05:33.639015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6a869e1e00fc4d8d9d4511e34501665f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}] Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: f301573dbb914d7a948851cb060d8483 Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.640453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '70dc9074-c661-48fa-ba87-ef45db17143b'} Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:33.641382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.642767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.651736 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Returning 404 to user: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:33.651736 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f0fb5f8b-eb2b-4175-ad55-57388501bf79 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "DELETE /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 404 len: 111 microversion: 2.1 time: 0.042652 Jul 28 04:05:33.651736 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 436/848] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:33 2022] DELETE /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:33.656967 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.657541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 70dc9074-c661-48fa-ba87-ef45db17143b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:33.664407 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.665704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.666505 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.667183 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.692552 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] HTTP exception thrown: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Request method failure captured: Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b HTTP/1.1 Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gl_PM82xQgI6yZLI0aabg0s_CtUzE5TczQ-7KoZjaRn90NY40c-VQaXkVJora5SjgKxsVLO35UUfZ5WW3T65hzKnVGT8GbjlAESmHVtyLMdaAc2c-jv-VNZjhUaadgGN9PVGPefcJyIydX6NLbH9IGAL_wuHgqaJmaEjO_p1NNTYQU Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:05:33.694199 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6a869e1e00fc4d8d9d4511e34501665f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}] Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: f301573dbb914d7a948851cb060d8483 Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.695789 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '70dc9074-c661-48fa-ba87-ef45db17143b'} Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:33.696559 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. Jul 28 04:05:33.697737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.698804 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Returning 404 to user: Instance 70dc9074-c661-48fa-ba87-ef45db17143b could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:33.698804 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1de0a9ec-bd6b-4674-8afb-05985d787019 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b" status: 404 len: 111 microversion: 2.1 time: 0.043239 Jul 28 04:05:33.698804 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 413/849] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:33 2022] GET /compute/v2.1/servers/70dc9074-c661-48fa-ba87-ef45db17143b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:33.876695 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.877315 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] [instance: 1ed19419-f0b9-473d-93cb-fefb8c29d74e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:33.884189 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.884873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.885642 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.886111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] HTTP exception thrown: Instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e could not be found. Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Request method failure captured: Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e HTTP/1.1 Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gm9v0-9lh5I7dolKET2pD6SW785nL6rF8jSH5WF57T_IhyjgRsHD-7WsKFCSZWAkgza4tXSkvBLcWqxv6Zhoe1j4EtYWEeiPNVqkNohAX6l1V2ojffm8Ix96GUxMEj3Ybm3sFedJNcy3aEWn9AChvPq5HWQQRg36wgTiBdNTCZpipM Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 5e16f8abc2ed4df1b2834b1669b67a1b Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-TestShelveInstance-1891572734 Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:05:33.908835 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5e16f8abc2ed4df1b2834b1669b67a1b", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e16f8abc2ed4df1b2834b1669b67a1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5e16f8abc2ed4df1b2834b1669b67a1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e16f8abc2ed4df1b2834b1669b67a1b"}]}] Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-TestShelveInstance-1891572734 Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 5e16f8abc2ed4df1b2834b1669b67a1b Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-TestShelveInstance-1891572734 Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-TestShelveInstance-1891572734-project Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: efddbdbab2724260a3efd7d01fc39bed Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-TestShelveInstance-1891572734-project Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e could not be found. Jul 28 04:05:33.911886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '1ed19419-f0b9-473d-93cb-fefb8c29d74e'} Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e could not be found. Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:33.916453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e could not be found. Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e could not be found. Jul 28 04:05:33.921882 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.924512 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Returning 404 to user: Instance 1ed19419-f0b9-473d-93cb-fefb8c29d74e could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:33.924512 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e4bd15b0-a79d-4bd0-83fa-b01d84bfd6d3 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e" status: 404 len: 111 microversion: 2.1 time: 0.034546 Jul 28 04:05:33.924512 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 437/850] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:33 2022] GET /compute/v2.1/servers/1ed19419-f0b9-473d-93cb-fefb8c29d74e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:34.288498 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a5c024f4-ffa8-4b04-84b8-8c09bf08e9f1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] Calling method '.version_select at 0x7f5572e73dc0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:34.367441 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:34.368249 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:34.381748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:34.381748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:34.381748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:34.381748 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:34.405611 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a5c024f4-ffa8-4b04-84b8-8c09bf08e9f1 tempest-TestShelveInstance-1891572734 tempest-TestShelveInstance-1891572734-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1834974013" status: 202 len: 0 microversion: 2.1 time: 0.120427 Jul 28 04:05:34.407647 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 414/851] 10.222.0.66 () {58 vars in 1254 bytes} [Thu Jul 28 04:05:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1834974013 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:05:34.569243 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:34.585731 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:34.585731 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:34.585731 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a72ecc82-7bfe-4011-8abc-665f3cedf048 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.219956 Jul 28 04:05:34.586089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 438/852] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:34 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:35.024679 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:35.025360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:35.032633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.033237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:35.034077 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.034583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:35.049166 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] HTTP exception thrown: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Request method failure captured: Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e HTTP/1.1 Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gl_PM82xQgI6yZLI0aabg0s_CtUzE5TczQ-7KoZjaRn90NY40c-VQaXkVJora5SjgKxsVLO35UUfZ5WW3T65hzKnVGT8GbjlAESmHVtyLMdaAc2c-jv-VNZjhUaadgGN9PVGPefcJyIydX6NLbH9IGAL_wuHgqaJmaEjO_p1NNTYQU Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:05:35.050751 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6a869e1e00fc4d8d9d4511e34501665f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}] Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: f301573dbb914d7a948851cb060d8483 Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.052369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '69722c89-ea87-415c-8a3c-b10f0bff6b9e'} Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:35.053255 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.054644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.057115 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Returning 404 to user: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:35.057115 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0d969c17-94f5-4f07-94c8-7e7dfc7d2a48 tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "DELETE /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 404 len: 111 microversion: 2.1 time: 0.031901 Jul 28 04:05:35.057115 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 415/853] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:35 2022] DELETE /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:35.065585 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:35.068394 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] [instance: 69722c89-ea87-415c-8a3c-b10f0bff6b9e] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:35.073998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.074122 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:35.075046 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.075500 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:35.091317 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] HTTP exception thrown: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Request method failure captured: Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e HTTP/1.1 Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gl_PM82xQgI6yZLI0aabg0s_CtUzE5TczQ-7KoZjaRn90NY40c-VQaXkVJora5SjgKxsVLO35UUfZ5WW3T65hzKnVGT8GbjlAESmHVtyLMdaAc2c-jv-VNZjhUaadgGN9PVGPefcJyIydX6NLbH9IGAL_wuHgqaJmaEjO_p1NNTYQU Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:05:35.092913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6a869e1e00fc4d8d9d4511e34501665f", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6a869e1e00fc4d8d9d4511e34501665f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6a869e1e00fc4d8d9d4511e34501665f"}]}] Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 6a869e1e00fc4d8d9d4511e34501665f Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842565300 Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: f301573dbb914d7a948851cb060d8483 Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeTestJSON-1842565300-project Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.094588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '69722c89-ea87-415c-8a3c-b10f0bff6b9e'} Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:35.095454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. Jul 28 04:05:35.096953 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:35.099384 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] Returning 404 to user: Instance 69722c89-ea87-415c-8a3c-b10f0bff6b9e could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:35.099384 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0934d0d6-a667-4118-9605-6fbb9935f00f tempest-AttachVolumeTestJSON-1842565300 tempest-AttachVolumeTestJSON-1842565300-project] 10.222.0.66 "GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e" status: 404 len: 111 microversion: 2.1 time: 0.033175 Jul 28 04:05:35.099384 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 439/854] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:35 2022] GET /compute/v2.1/servers/69722c89-ea87-415c-8a3c-b10f0bff6b9e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:35.478385 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-cf27b653-8e88-4579-aa27-e27e3a718a19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:35.479890 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-cf27b653-8e88-4579-aa27-e27e3a718a19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:35.490067 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf27b653-8e88-4579-aa27-e27e3a718a19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.490618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf27b653-8e88-4579-aa27-e27e3a718a19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:35.492077 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf27b653-8e88-4579-aa27-e27e3a718a19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.492077 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf27b653-8e88-4579-aa27-e27e3a718a19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:35.607460 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:35.608136 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:35.621993 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.623686 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-cf27b653-8e88-4579-aa27-e27e3a718a19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lazy-loading 'services' on Instance uuid f2fa4aca-3faa-4e71-930d-e9070e320b36 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:35.624060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:35.625062 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.628058 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:35.952428 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:35.973707 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-cf27b653-8e88-4579-aa27-e27e3a718a19 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments/23b31177-87e3-40ce-9d18-4c3886a4364c" status: 202 len: 0 microversion: 2.1 time: 0.500662 Jul 28 04:05:35.975174 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 416/855] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:05:35 2022] DELETE /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments/23b31177-87e3-40ce-9d18-4c3886a4364c => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:05:35.976831 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:35.989899 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:35.992629 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a6b4f5c1-92b6-4822-92c9-916f08b1d313 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.388718 Jul 28 04:05:35.999336 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 440/856] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:35 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:35.999437 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-62811ac7-761e-4334-8cd5-ca434d3edfd5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:36.001393 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-62811ac7-761e-4334-8cd5-ca434d3edfd5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:36.008961 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-62811ac7-761e-4334-8cd5-ca434d3edfd5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:36.010567 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-62811ac7-761e-4334-8cd5-ca434d3edfd5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:36.011587 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-62811ac7-761e-4334-8cd5-ca434d3edfd5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:36.012248 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-62811ac7-761e-4334-8cd5-ca434d3edfd5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:36.066984 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-62811ac7-761e-4334-8cd5-ca434d3edfd5 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085087 Jul 28 04:05:36.068108 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 417/857] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:35 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:37.032726 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:37.033971 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:37.049055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:37.049778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:37.050772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:37.051383 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:37.083338 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-55842b63-d4ee-4c43-892a-0321a517e28e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:37.085868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-55842b63-d4ee-4c43-892a-0321a517e28e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:37.103135 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-55842b63-d4ee-4c43-892a-0321a517e28e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:37.106033 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-55842b63-d4ee-4c43-892a-0321a517e28e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:37.107297 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-55842b63-d4ee-4c43-892a-0321a517e28e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:37.107933 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-55842b63-d4ee-4c43-892a-0321a517e28e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:37.156272 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-55842b63-d4ee-4c43-892a-0321a517e28e tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078852 Jul 28 04:05:37.157986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 418/858] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:37 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:37.363908 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:37.383253 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:37.389986 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:37.394437 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b2672fde-3caf-4c81-af81-0fafad89038c tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1731 microversion: 2.20 time: 0.372290 Jul 28 04:05:37.396958 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 441/859] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:37 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1731 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:38.174632 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ab8f02ff-2494-4c5b-892c-b03796bb0697 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:38.176848 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ab8f02ff-2494-4c5b-892c-b03796bb0697 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:38.185217 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ab8f02ff-2494-4c5b-892c-b03796bb0697 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:38.189025 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ab8f02ff-2494-4c5b-892c-b03796bb0697 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:38.189025 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ab8f02ff-2494-4c5b-892c-b03796bb0697 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:38.189025 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ab8f02ff-2494-4c5b-892c-b03796bb0697 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:38.233649 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ab8f02ff-2494-4c5b-892c-b03796bb0697 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063082 Jul 28 04:05:38.234899 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 419/860] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:38 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:05:38.338834 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-42580186-c82e-4e4c-b50b-2d52779ef21d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:38.339522 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-42580186-c82e-4e4c-b50b-2d52779ef21d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:38.353273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-42580186-c82e-4e4c-b50b-2d52779ef21d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:38.358281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-42580186-c82e-4e4c-b50b-2d52779ef21d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:38.359717 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-42580186-c82e-4e4c-b50b-2d52779ef21d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:38.360809 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-42580186-c82e-4e4c-b50b-2d52779ef21d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:38.404161 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-42580186-c82e-4e4c-b50b-2d52779ef21d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:05:38.420289 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:38.421147 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:38.436365 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:38.438955 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:38.447231 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:38.447991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:38.817470 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-42580186-c82e-4e4c-b50b-2d52779ef21d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 204 len: 0 microversion: 2.1 time: 0.483275 Jul 28 04:05:38.819208 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 442/861] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:38 2022] DELETE /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:38.829543 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-cd126208-ebb0-4431-a303-4a2403e51793 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:38.830862 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-cd126208-ebb0-4431-a303-4a2403e51793 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:38.852621 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd126208-ebb0-4431-a303-4a2403e51793 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:38.855331 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd126208-ebb0-4431-a303-4a2403e51793 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:38.859550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd126208-ebb0-4431-a303-4a2403e51793 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:38.860095 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-cd126208-ebb0-4431-a303-4a2403e51793 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:38.981355 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:38.994852 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:39.000644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:39.001913 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-195e0aaa-7a28-4a47-863d-84d8cf64bba0 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1718 microversion: 2.20 time: 0.587261 Jul 28 04:05:39.002494 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 420/862] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:38 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1718 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:39.235082 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-cd126208-ebb0-4431-a303-4a2403e51793 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:39.257224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-cd126208-ebb0-4431-a303-4a2403e51793 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1682 microversion: 2.1 time: 0.431491 Jul 28 04:05:39.260522 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 443/863] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:38 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1682 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:40.281728 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e37bcec4-fa1b-4bfa-92b6-7a5e6df2ce1f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:40.282365 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e37bcec4-fa1b-4bfa-92b6-7a5e6df2ce1f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:40.292389 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e37bcec4-fa1b-4bfa-92b6-7a5e6df2ce1f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:40.293245 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e37bcec4-fa1b-4bfa-92b6-7a5e6df2ce1f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:40.294034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e37bcec4-fa1b-4bfa-92b6-7a5e6df2ce1f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:40.294476 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e37bcec4-fa1b-4bfa-92b6-7a5e6df2ce1f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:40.819682 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e37bcec4-fa1b-4bfa-92b6-7a5e6df2ce1f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:40.833679 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e37bcec4-fa1b-4bfa-92b6-7a5e6df2ce1f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1682 microversion: 2.1 time: 0.554843 Jul 28 04:05:40.837204 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 421/864] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:40 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1682 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:41.878059 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-be2cb5db-4c7e-493a-a1a6-8aa9133b1afb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:41.879737 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-be2cb5db-4c7e-493a-a1a6-8aa9133b1afb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:41.894058 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-be2cb5db-4c7e-493a-a1a6-8aa9133b1afb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:41.895112 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-be2cb5db-4c7e-493a-a1a6-8aa9133b1afb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:41.896248 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-be2cb5db-4c7e-493a-a1a6-8aa9133b1afb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:41.896872 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-be2cb5db-4c7e-493a-a1a6-8aa9133b1afb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:42.027177 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-be2cb5db-4c7e-493a-a1a6-8aa9133b1afb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:42.040394 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-be2cb5db-4c7e-493a-a1a6-8aa9133b1afb tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1615 microversion: 2.1 time: 0.168228 Jul 28 04:05:42.041023 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 444/865] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:41 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1615 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:42.566724 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-6f8a6cd9-d0f4-4311-9357-62acdd1a20cf req-647eba33-a53e-4cc8-b258-905a01a41ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fa4aca-3faa-4e71-930d-e9070e320b36", "name": "network-vif-deleted", "tag": "2b8528eb-bc69-4fed-a16b-cf002901bbcd"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:42.598376 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-6f8a6cd9-d0f4-4311-9357-62acdd1a20cf req-647eba33-a53e-4cc8-b258-905a01a41ade service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:42.600553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-6f8a6cd9-d0f4-4311-9357-62acdd1a20cf req-647eba33-a53e-4cc8-b258-905a01a41ade service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:42.636118 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-6f8a6cd9-d0f4-4311-9357-62acdd1a20cf req-647eba33-a53e-4cc8-b258-905a01a41ade service nova] Creating event network-vif-deleted:2b8528eb-bc69-4fed-a16b-cf002901bbcd for instance f2fa4aca-3faa-4e71-930d-e9070e320b36 on hv-cinder-85127 Jul 28 04:05:42.658219 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-6f8a6cd9-d0f4-4311-9357-62acdd1a20cf req-647eba33-a53e-4cc8-b258-905a01a41ade service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097623 Jul 28 04:05:42.661129 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 422/866] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:43.081507 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:43.082584 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:43.096072 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:43.097571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:43.100319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:43.100319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:43.179389 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:43.179911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:43.180516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lazy-loading 'fault' on Instance uuid f2fa4aca-3faa-4e71-930d-e9070e320b36 {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:43.597308 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b7380889a4411cb57465ab5d33ba75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68fb083db524ab59ba49d71ae754ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:43.615363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-844985fa-b0b9-4172-ba52-b6cc8c6cec8f tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 200 len: 1331 microversion: 2.1 time: 0.536820 Jul 28 04:05:43.617288 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 445/867] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:43 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 1331 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:44.654165 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:44.655817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:44.658988 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:44.687241 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:44.688220 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:44.689225 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:44.690111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:44.707448 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 HTTP/1.1 Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:05:44.709192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:44.715851 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': 'f2fa4aca-3faa-4e71-930d-e9070e320b36'} Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:44.717464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:44.720170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:44.722485 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:44.722485 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a90170bc-6d7b-4b52-96c6-115708acad12 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 404 len: 111 microversion: 2.1 time: 0.061583 Jul 28 04:05:44.722485 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 423/868] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:44 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:44.722924 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-064a2cc9-a214-4949-a14b-d6793c51441d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '.version_select at 0x7f5572ed5550>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:44.808958 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-064a2cc9-a214-4949-a14b-d6793c51441d tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016752909" status: 202 len: 0 microversion: 2.1 time: 0.092299 Jul 28 04:05:44.813045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 446/869] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Jul 28 04:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016752909 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:05:47.343220 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:47.343749 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:47.353539 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:47.353995 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:47.354781 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:47.355224 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:47.369372 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 HTTP/1.1 Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:05:47.370926 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.372480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': 'f2fa4aca-3faa-4e71-930d-e9070e320b36'} Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:47.373664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.375162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.380431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:47.380431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-76031a6a-26ab-4537-8862-e7ecbf640837 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 404 len: 111 microversion: 2.1 time: 0.033171 Jul 28 04:05:47.380431 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 424/870] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:47 2022] DELETE /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:47.381353 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:47.381978 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: f2fa4aca-3faa-4e71-930d-e9070e320b36] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:47.390065 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:47.390527 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:47.391352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:47.391803 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:47.406152 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 HTTP/1.1 Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:05:47.407823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.409516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': 'f2fa4aca-3faa-4e71-930d-e9070e320b36'} Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:47.410590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. Jul 28 04:05:47.412123 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:47.413407 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance f2fa4aca-3faa-4e71-930d-e9070e320b36 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:47.413407 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2f83e261-7d4c-4583-bd91-b223b71455d7 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36" status: 404 len: 111 microversion: 2.1 time: 0.031998 Jul 28 04:05:47.413407 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 447/871] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:47 2022] GET /compute/v2.1/servers/f2fa4aca-3faa-4e71-930d-e9070e320b36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:48.804191 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:48.805039 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:48.815092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.815092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.815092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.815092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.830997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b HTTP/1.1 Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:05:48.832631 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.835143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '04979300-ed48-49df-85a4-13db2fae199b'} Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:48.837870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.840240 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.842505 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:48.842505 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2e8a23b4-03b6-4a21-bfc0-2e4aad81166a tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 404 len: 111 microversion: 2.1 time: 0.036149 Jul 28 04:05:48.842505 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 425/872] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:48 2022] DELETE /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:05:48.843470 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:48.849587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 04979300-ed48-49df-85a4-13db2fae199b] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:48.849587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:48.855810 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.856640 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.857714 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.858179 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.880869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b HTTP/1.1 Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:05:48.884951 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.886426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '04979300-ed48-49df-85a4-13db2fae199b'} Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:48.887724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. Jul 28 04:05:48.889050 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.890413 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance 04979300-ed48-49df-85a4-13db2fae199b could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:48.890413 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d74d825b-6201-4f36-a503-f727af1b51f1 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b" status: 404 len: 111 microversion: 2.1 time: 0.047323 Jul 28 04:05:48.890413 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 448/873] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:48 2022] GET /compute/v2.1/servers/04979300-ed48-49df-85a4-13db2fae199b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:48.899427 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:48.900256 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:48.907414 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.907866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.908717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.909160 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.935304 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce HTTP/1.1 Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:05:48.941840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:48.944705 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '7be29dfe-7a22-4f92-bcc4-5949f0565cce'} Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:48.946717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:48.948618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:48.950921 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:48.950921 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9bade391-f224-4e35-9720-51ac2401eec9 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 404 len: 111 microversion: 2.1 time: 0.047280 Jul 28 04:05:48.950921 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 426/874] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:48 2022] DELETE /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:05:48.957869 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:48.959057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 7be29dfe-7a22-4f92-bcc4-5949f0565cce] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:48.971363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.972297 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.973743 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.974554 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:49.002665 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce HTTP/1.1 Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:05:49.005720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:49.009893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '7be29dfe-7a22-4f92-bcc4-5949f0565cce'} Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:49.017464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. Jul 28 04:05:49.019873 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:49.023084 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance 7be29dfe-7a22-4f92-bcc4-5949f0565cce could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:49.023084 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-edb4d834-a4f8-4cc7-94ea-8ff50cbe8904 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce" status: 404 len: 111 microversion: 2.1 time: 0.058386 Jul 28 04:05:49.023084 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 449/875] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:48 2022] GET /compute/v2.1/servers/7be29dfe-7a22-4f92-bcc4-5949f0565cce => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:50.381777 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:50.384162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:50.392970 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.393593 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.394717 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.395452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.418091 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 HTTP/1.1 Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:05:50.420320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.423036 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '4ce0e823-630b-4503-9b49-e9d5d43b2605'} Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:50.427942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.431775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.441623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:50.441623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c8d99320-40e7-4b1c-b4e4-f50ddc844b45 tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 404 len: 111 microversion: 2.1 time: 0.046006 Jul 28 04:05:50.441623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 427/876] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:50 2022] DELETE /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:50.442196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:50.442956 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] [instance: 4ce0e823-630b-4503-9b49-e9d5d43b2605] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:50.451672 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.452258 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.453118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.453588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.469641 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] HTTP exception thrown: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Request method failure captured: Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 HTTP/1.1 Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmGgoDkx3TIlsxkxipvhyiRRKg_-MF8F-25P8G4HTQUFXdNCZh3xeNO5pNM7JmBZz4-QhRTMj3mqoo8CjR9iEPj0Sf4YGdvNi1N7C5ZdYazj2rp9gPW2aCDcFP-DXXS_01kxZUyIVrZ5QxGOjNmj6hLbXx_nXnHe80IqRSiTRuCIME Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:05:50.471235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f68fb083db524ab59ba49d71ae754ba0", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f68fb083db524ab59ba49d71ae754ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f68fb083db524ab59ba49d71ae754ba0"}]}] Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: f68fb083db524ab59ba49d71ae754ba0 Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-825532803 Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 37b7380889a4411cb57465ab5d33ba75 Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeNegativeTest-825532803-project Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.473800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '4ce0e823-630b-4503-9b49-e9d5d43b2605'} Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:50.475119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. Jul 28 04:05:50.478042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:05:50.480130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] Returning 404 to user: Instance 4ce0e823-630b-4503-9b49-e9d5d43b2605 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:50.480130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2a478d65-4cae-4c3b-b226-20f815f2821c tempest-AttachVolumeNegativeTest-825532803 tempest-AttachVolumeNegativeTest-825532803-project] 10.222.0.66 "GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605" status: 404 len: 111 microversion: 2.1 time: 0.037406 Jul 28 04:05:50.480130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 450/877] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:50 2022] GET /compute/v2.1/servers/4ce0e823-630b-4503-9b49-e9d5d43b2605 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:07.543366 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=9 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:07.544112 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:07.768589 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8aeb5abb-e7de-42c3-a98e-f2ba2a965ceb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Action: 'create', calling method: .version_select at 0x7f5572d83a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-743574221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1Qw13ZuEeb843gsKPa+D0SL/JsklIGrVuPVuIfE3jbFEatN6LbjpazPNSgzq2naSyWsZEqF7fqzA4Dg7PI1Dfxjk8/C+vS0/OGe5lJLag0urhIJMDXIGhlFbf/J51Axg=="}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:07.787412 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-8aeb5abb-e7de-42c3-a98e-f2ba2a965ceb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Getting quotas for project 9aa592e1b58f4804ad264f0cd721b1ca. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:06:07.793374 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-8aeb5abb-e7de-42c3-a98e-f2ba2a965ceb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Getting quotas for user 44734ee22727449fafcd470798c10abd and project 9aa592e1b58f4804ad264f0cd721b1ca. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:06:07.886354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8aeb5abb-e7de-42c3-a98e-f2ba2a965ceb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.348937 Jul 28 04:06:07.887380 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 428/878] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 04:06:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:09.866989 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c8a58968-f5fc-423b-a28f-cedb0a22ceed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:09.870761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c8a58968-f5fc-423b-a28f-cedb0a22ceed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:09.878918 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:09.884550 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c8a58968-f5fc-423b-a28f-cedb0a22ceed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:09.885196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c8a58968-f5fc-423b-a28f-cedb0a22ceed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:09.886002 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c8a58968-f5fc-423b-a28f-cedb0a22ceed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:09.886700 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c8a58968-f5fc-423b-a28f-cedb0a22ceed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:09.920632 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c8a58968-f5fc-423b-a28f-cedb0a22ceed tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058522 Jul 28 04:06:09.921581 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 451/879] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Jul 28 04:06:09 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:10.010233 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-06ee2199-0361-4983-9d37-ee05f2651c95 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:10.012865 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-06ee2199-0361-4983-9d37-ee05f2651c95 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:10.019082 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-06ee2199-0361-4983-9d37-ee05f2651c95 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.019529 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-06ee2199-0361-4983-9d37-ee05f2651c95 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.020347 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-06ee2199-0361-4983-9d37-ee05f2651c95 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.020781 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-06ee2199-0361-4983-9d37-ee05f2651c95 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.060074 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-06ee2199-0361-4983-9d37-ee05f2651c95 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:06:10.427436 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-06ee2199-0361-4983-9d37-ee05f2651c95 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "DELETE /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 204 len: 0 microversion: 2.20 time: 0.422496 Jul 28 04:06:10.428055 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 429/880] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Jul 28 04:06:10 2022] DELETE /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 04:06:10.441950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:10.443117 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:10.454888 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.457314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.457314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.457314 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.613507 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:10.634356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:10.636591 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:10.638149 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-218676ce-24a3-46ea-a4f2-987fb393d6e9 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.204326 Jul 28 04:06:10.639663 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 452/881] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:10 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:11.668117 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:11.668117 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:11.675106 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:11.683704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:11.685599 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:11.686401 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:12.115648 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:12.130094 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:12.139062 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:12.140396 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0f798a5f-4c47-4c3d-9ea4-245f2583b60f tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1724 microversion: 2.20 time: 0.480611 Jul 28 04:06:12.149025 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 430/882] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:11 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:13.194458 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:13.195547 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:13.235788 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-bf7e2099-58c6-4c1b-945c-3fb017b40de4 req-47849c90-8e40-4ef9-8810-049dce4b643d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29710033-f00f-435c-8485-9dd60d728f27", "name": "network-vif-deleted", "tag": "de721302-c218-45d7-87a1-d79d5e51a7e4"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:13.257713 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-bf7e2099-58c6-4c1b-945c-3fb017b40de4 req-47849c90-8e40-4ef9-8810-049dce4b643d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.258812 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-bf7e2099-58c6-4c1b-945c-3fb017b40de4 req-47849c90-8e40-4ef9-8810-049dce4b643d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.269889 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.269889 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.270626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.272049 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.294318 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-bf7e2099-58c6-4c1b-945c-3fb017b40de4 req-47849c90-8e40-4ef9-8810-049dce4b643d service nova] Creating event network-vif-deleted:de721302-c218-45d7-87a1-d79d5e51a7e4 for instance 29710033-f00f-435c-8485-9dd60d728f27 on hv-cinder-85127 Jul 28 04:06:13.308827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-bf7e2099-58c6-4c1b-945c-3fb017b40de4 req-47849c90-8e40-4ef9-8810-049dce4b643d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080455 Jul 28 04:06:13.341550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 431/883] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:13.517602 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:13.545401 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:13.549812 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3333bf3bc149139f9f6b4e89d2e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b087e8dc5c4426b8402dfdf99328ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:13.552998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-195031a7-2489-4430-8c0a-cf0304a5cf1b tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 200 len: 1656 microversion: 2.20 time: 0.364592 Jul 28 04:06:13.554931 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 453/884] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:13 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 1656 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:14.585714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:14.585714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:14.593453 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:14.594405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:14.596137 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:14.596736 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:14.627209 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] HTTP exception thrown: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Request method failure captured: Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 HTTP/1.1 Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmF81-maHFWXAa0eF722ZJ-NN0Di0z-iuOcncK5PmXpwTFYQ99YRfOEWhqOxCFkWe9zge9d2PMeoHDMfSH8ylZyxSThi6MAdtSkff6g2eK2qi7qIUAKbEdxsG4YqH1ATB_JxpF-7K0xaTBV4F7Msy9r0bL4SOdKzn3XwnukRnNzTO8 Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:06:14.630361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52b087e8dc5c4426b8402dfdf99328ad", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}] Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: cf3333bf3bc149139f9f6b4e89d2e89b Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:14.642621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '29710033-f00f-435c-8485-9dd60d728f27'} Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:14.644512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:14.647258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.650041 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Returning 404 to user: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:14.650041 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-08c556f5-e0c5-4b42-82b4-54bc581d0da6 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 404 len: 111 microversion: 2.20 time: 0.054986 Jul 28 04:06:14.650041 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 432/885] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:14 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 04:06:14.652890 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b394b046-83f2-45e2-9818-16d8b71f2ec4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '.version_select at 0x7f5572ec2160>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:14.828543 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b394b046-83f2-45e2-9818-16d8b71f2ec4 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843774019" status: 204 len: 0 microversion: 2.20 time: 0.181465 Jul 28 04:06:14.829675 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 454/886] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Jul 28 04:06:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843774019 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 04:06:17.100370 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:17.105529 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:17.111484 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.112228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.113958 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.114416 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.139604 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] HTTP exception thrown: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Request method failure captured: Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 HTTP/1.1 Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmF81-maHFWXAa0eF722ZJ-NN0Di0z-iuOcncK5PmXpwTFYQ99YRfOEWhqOxCFkWe9zge9d2PMeoHDMfSH8ylZyxSThi6MAdtSkff6g2eK2qi7qIUAKbEdxsG4YqH1ATB_JxpF-7K0xaTBV4F7Msy9r0bL4SOdKzn3XwnukRnNzTO8 Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:06:17.140667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52b087e8dc5c4426b8402dfdf99328ad", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}] Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: cf3333bf3bc149139f9f6b4e89d2e89b Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.142202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '29710033-f00f-435c-8485-9dd60d728f27'} Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:17.143228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.144653 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.146607 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Returning 404 to user: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:17.146607 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a46d9cf1-b0ce-4c7f-bc19-8684ec75e601 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "DELETE /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 404 len: 111 microversion: 2.20 time: 0.046419 Jul 28 04:06:17.151184 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:17.151925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 29710033-f00f-435c-8485-9dd60d728f27] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:17.156246 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 433/887] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Jul 28 04:06:17 2022] DELETE /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:06:17.163946 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.164511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.165963 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.166541 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.182385 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] HTTP exception thrown: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Request method failure captured: Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 HTTP/1.1 Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmF81-maHFWXAa0eF722ZJ-NN0Di0z-iuOcncK5PmXpwTFYQ99YRfOEWhqOxCFkWe9zge9d2PMeoHDMfSH8ylZyxSThi6MAdtSkff6g2eK2qi7qIUAKbEdxsG4YqH1ATB_JxpF-7K0xaTBV4F7Msy9r0bL4SOdKzn3XwnukRnNzTO8 Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:06:17.184009 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52b087e8dc5c4426b8402dfdf99328ad", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}] Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: cf3333bf3bc149139f9f6b4e89d2e89b Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.192071 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '29710033-f00f-435c-8485-9dd60d728f27'} Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:17.193168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. Jul 28 04:06:17.195514 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.197772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Returning 404 to user: Instance 29710033-f00f-435c-8485-9dd60d728f27 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:17.197772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-01d9c0ab-1594-4503-b2d4-3c8c3f4bcea1 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27" status: 404 len: 111 microversion: 2.20 time: 0.038399 Jul 28 04:06:17.197772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 455/888] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:17 2022] GET /compute/v2.1/servers/29710033-f00f-435c-8485-9dd60d728f27 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:06:18.616997 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:18.617784 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:18.621517 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=4 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:18.627885 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.628368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.629234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.629684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.645172 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] HTTP exception thrown: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Request method failure captured: Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac HTTP/1.1 Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gmF81-maHFWXAa0eF722ZJ-NN0Di0z-iuOcncK5PmXpwTFYQ99YRfOEWhqOxCFkWe9zge9d2PMeoHDMfSH8ylZyxSThi6MAdtSkff6g2eK2qi7qIUAKbEdxsG4YqH1ATB_JxpF-7K0xaTBV4F7Msy9r0bL4SOdKzn3XwnukRnNzTO8 Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:06:18.646779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52b087e8dc5c4426b8402dfdf99328ad", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}] Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: cf3333bf3bc149139f9f6b4e89d2e89b Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.649168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '4eadfe50-2ab9-46dc-be42-b9496e4008ac'} Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:18.650228 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.651944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.655362 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Returning 404 to user: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:18.655362 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7e13c9db-b5c1-4a62-b3bc-0dbb5c766eb8 tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 404 len: 111 microversion: 2.20 time: 0.036584 Jul 28 04:06:18.655362 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 434/889] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Jul 28 04:06:18 2022] DELETE /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:06:18.663096 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:18.664493 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] [instance: 4eadfe50-2ab9-46dc-be42-b9496e4008ac] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:18.676181 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.676949 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.678286 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.678940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.704450 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] HTTP exception thrown: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Request method failure captured: Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac HTTP/1.1 Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gmF81-maHFWXAa0eF722ZJ-NN0Di0z-iuOcncK5PmXpwTFYQ99YRfOEWhqOxCFkWe9zge9d2PMeoHDMfSH8ylZyxSThi6MAdtSkff6g2eK2qi7qIUAKbEdxsG4YqH1ATB_JxpF-7K0xaTBV4F7Msy9r0bL4SOdKzn3XwnukRnNzTO8 Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:06:18.714939 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52b087e8dc5c4426b8402dfdf99328ad", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52b087e8dc5c4426b8402dfdf99328ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52b087e8dc5c4426b8402dfdf99328ad"}]}] Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 52b087e8dc5c4426b8402dfdf99328ad Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-662774213 Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: cf3333bf3bc149139f9f6b4e89d2e89b Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-AttachVolumeShelveTestJSON-662774213-project Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.717235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '4eadfe50-2ab9-46dc-be42-b9496e4008ac'} Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:18.718060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. Jul 28 04:06:18.719363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.720558 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] Returning 404 to user: Instance 4eadfe50-2ab9-46dc-be42-b9496e4008ac could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:18.720558 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2065898f-519e-40f3-a171-f98cf494c48d tempest-AttachVolumeShelveTestJSON-662774213 tempest-AttachVolumeShelveTestJSON-662774213-project] 10.222.0.66 "GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac" status: 404 len: 111 microversion: 2.20 time: 0.051851 Jul 28 04:06:18.720558 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 456/890] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:18 2022] GET /compute/v2.1/servers/4eadfe50-2ab9-46dc-be42-b9496e4008ac => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:06:26.100916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-edece621-1369-4ce5-b90b-45549ac50742 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Action: 'create', calling method: .version_select at 0x7f5572d83790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-120421559"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:27.130722 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-edece621-1369-4ce5-b90b-45549ac50742 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.201584 Jul 28 04:06:27.131542 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 435/891] 10.222.0.66 () {60 vars in 1155 bytes} [Thu Jul 28 04:06:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1203 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 04:06:27.148211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3a462b43-6184-4480-bd55-6a8aad9eef83 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572e1ed30>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:27.215346 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3a462b43-6184-4480-bd55-6a8aad9eef83 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 200 len: 344 microversion: 2.1 time: 0.072517 Jul 28 04:06:27.216207 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 457/892] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:27 2022] GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:28.237828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2db9e135-894c-4b78-b051-e090b31e29cd tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572da9b80>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:28.313895 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2db9e135-894c-4b78-b051-e090b31e29cd tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 200 len: 345 microversion: 2.1 time: 0.082651 Jul 28 04:06:28.314936 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 436/893] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:28 2022] GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:28.334061 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-dd0a1884-2b8e-427f-aea3-0a49b00f9680 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Action: 'create', calling method: .version_select at 0x7f5572d06310>, body: {"snapshot": {"volume_id": "d8157b53-dfe4-40ed-8ee9-2adc95ffa15a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1170929186"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:28.671444 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:28.704190 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=22 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:29.014422 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-dd0a1884-2b8e-427f-aea3-0a49b00f9680 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.684082 Jul 28 04:06:29.022980 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 458/894] 10.222.0.66 () {60 vars in 1162 bytes} [Thu Jul 28 04:06:28 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:29.027132 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-151f9423-1288-4c08-bf84-cd8f1c2123f7 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572d75e50>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:29.034127 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:29.034981 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:29.065901 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-151f9423-1288-4c08-bf84-cd8f1c2123f7 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4" status: 200 len: 287 microversion: 2.1 time: 0.042427 Jul 28 04:06:29.066577 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 437/895] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Jul 28 04:06:29 2022] GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:29.081289 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-98c3c7e7-567a-487c-9a5d-8cd0e1312d0b tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572f203a0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:29.117015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-98c3c7e7-567a-487c-9a5d-8cd0e1312d0b tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.042374 Jul 28 04:06:29.119870 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 459/896] 10.222.0.66 () {58 vars in 1140 bytes} [Thu Jul 28 04:06:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:29.137802 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-dd57a52b-52c9-4539-82a3-58a7c05ae872 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572d83dc0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:29.178226 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-dd57a52b-52c9-4539-82a3-58a7c05ae872 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4" status: 200 len: 287 microversion: 2.1 time: 0.044320 Jul 28 04:06:29.179180 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 438/897] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Jul 28 04:06:29 2022] GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:30.096855 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-636797003", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-743574221", "security_groups": [{"name": "tempest-secgroup-smoke-1803004242"}], "block_device_mapping_v2": [{"uuid": "290237aa-9696-495a-ae7e-d3aa94d8e167", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "672eb351-e67a-4327-be23-b1a7215130a6"}]}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:30.192027 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1d9e0232-7f53-4099-ac67-905e883e62ad tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572db6c10>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:30.226876 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] validate_networks() for [('672eb351-e67a-4327-be23-b1a7215130a6', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:06:30.239408 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1d9e0232-7f53-4099-ac67-905e883e62ad tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4" status: 200 len: 287 microversion: 2.1 time: 0.052373 Jul 28 04:06:30.240288 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 439/898] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Jul 28 04:06:30 2022] GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:30.896196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:06:30.896505 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:06:30.896998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:06:30.897429 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:06:30.897839 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:06:30.909030 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:30.909493 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:30.910327 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:30.910778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:30.930057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Getting quotas for project 9aa592e1b58f4804ad264f0cd721b1ca. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:06:30.934876 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Getting quotas for user 44734ee22727449fafcd470798c10abd and project 9aa592e1b58f4804ad264f0cd721b1ca. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:06:30.998417 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:06:31.000641 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='290237aa-9696-495a-ae7e-d3aa94d8e167',volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:06:31.253807 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ed8ed886-e652-481f-b958-073350d81d23 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572d83040>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:31.292457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ed8ed886-e652-481f-b958-073350d81d23 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4" status: 200 len: 287 microversion: 2.1 time: 0.043305 Jul 28 04:06:31.293035 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 440/899] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Jul 28 04:06:31 2022] GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:31.662862 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8d3fa34b-b4fd-4cb4-8da7-d754d769b0c7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.570399 Jul 28 04:06:31.670012 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 460/900] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:06:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:06:31.678960 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-aa959647-603f-4a2a-97cd-07fe06e6e20a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:31.679889 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-aa959647-603f-4a2a-97cd-07fe06e6e20a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:31.750007 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-aa959647-603f-4a2a-97cd-07fe06e6e20a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:31.758581 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-aa959647-603f-4a2a-97cd-07fe06e6e20a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1093 microversion: 2.1 time: 0.083894 Jul 28 04:06:31.772706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 441/901] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:31 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1093 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:32.305343 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d4dfe5bf-7ca6-4b68-8273-6087fabdc262 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572ec2f70>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:32.339253 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d4dfe5bf-7ca6-4b68-8273-6087fabdc262 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4" status: 200 len: 288 microversion: 2.1 time: 0.037806 Jul 28 04:06:32.339866 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 461/902] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Jul 28 04:06:32 2022] GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:32.351291 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-95260b1c-3160-4b5e-83e7-e7f105a56dc3 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572d583a0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:32.556824 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-95260b1c-3160-4b5e-83e7-e7f105a56dc3 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4" status: 202 len: 0 microversion: 2.1 time: 0.208553 Jul 28 04:06:32.557497 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 442/903] 10.222.0.66 () {58 vars in 1254 bytes} [Thu Jul 28 04:06:32 2022] DELETE /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:06:32.567298 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2330b420-0b48-47f0-976e-8a538d62ce15 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572e8a0d0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:32.602269 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2330b420-0b48-47f0-976e-8a538d62ce15 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4" status: 200 len: 287 microversion: 2.1 time: 0.036950 Jul 28 04:06:32.602269 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 462/904] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Jul 28 04:06:32 2022] GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:32.783527 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b2bb0068-4b5d-4e4e-8ce8-26199736596d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:32.784190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b2bb0068-4b5d-4e4e-8ce8-26199736596d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:32.841388 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b2bb0068-4b5d-4e4e-8ce8-26199736596d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:32.849241 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b2bb0068-4b5d-4e4e-8ce8-26199736596d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1093 microversion: 2.1 time: 0.070519 Jul 28 04:06:32.849827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 443/905] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:32 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:33.612583 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e0ffbe83-7fac-4ef0-865c-d9911a4cad61 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572f2e8b0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:33.640060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-e0ffbe83-7fac-4ef0-865c-d9911a4cad61 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] HTTP exception thrown: Snapshot 41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 could not be found. Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e0ffbe83-7fac-4ef0-865c-d9911a4cad61 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Request method failure captured: Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 HTTP/1.1 Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gtBburPC-AwvNljlxxBoBbmAFLS08JnRTZvf1lQucvmiqIuFtyHjzE-tuPncL9Pi1cuUyFGPvgeVq0CCOAD5a1TeW-ms4g7YPvmvVdQV734ZtB2Gy79Wiuzy4ENP1aKGfHPOfHKwjLPncoDbcDz7FvhIK2ZCylWYcSw8mUsbVjl5U0 Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 4a0b6d12e9f04736a12af62214c0376d Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:06:33.656194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a0b6d12e9f04736a12af62214c0376d", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0b6d12e9f04736a12af62214c0376d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a0b6d12e9f04736a12af62214c0376d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0b6d12e9f04736a12af62214c0376d"}]}] Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 4a0b6d12e9f04736a12af62214c0376d Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-VolumesSnapshotsTestJSON-1903795320-project Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: aaade4058f354080904a83c19fd1ce68 Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1903795320-project Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Snapshot 41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 could not be found. Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '41cc44c7-41c5-4905-8a1b-bb2bad5f65e4'} Jul 28 04:06:33.657825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 could not be found. (HTTP 404) (Request-ID: req-9f87ac3d-78d2-4cd5-aa7b-6ae1ef7caa5c) Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:33.658911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:06:33.664379 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 could not be found. Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 04:06:33.668250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 could not be found. Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 could not be found. Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e0ffbe83-7fac-4ef0-865c-d9911a4cad61 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Returning 404 to user: Snapshot 41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:33.669792 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e0ffbe83-7fac-4ef0-865c-d9911a4cad61 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4" status: 404 len: 111 microversion: 2.1 time: 0.052340 Jul 28 04:06:33.670775 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 463/906] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Jul 28 04:06:33 2022] GET /compute/v2.1/os-snapshots/41cc44c7-41c5-4905-8a1b-bb2bad5f65e4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:33.671513 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-118e9853-aa66-4108-8b04-be8941717a8d tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572fe1160>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:33.871111 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-10a47278-1546-4ab0-becc-064406e12f02 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:33.871638 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-10a47278-1546-4ab0-becc-064406e12f02 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:33.878283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-10a47278-1546-4ab0-becc-064406e12f02 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:33.878731 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-10a47278-1546-4ab0-becc-064406e12f02 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:33.879508 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-10a47278-1546-4ab0-becc-064406e12f02 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:33.879969 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-10a47278-1546-4ab0-becc-064406e12f02 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:33.942954 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-118e9853-aa66-4108-8b04-be8941717a8d tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 202 len: 0 microversion: 2.1 time: 0.275900 Jul 28 04:06:33.943699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 444/907] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 04:06:33 2022] DELETE /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:06:33.943886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-10a47278-1546-4ab0-becc-064406e12f02 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:33.952031 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-10a47278-1546-4ab0-becc-064406e12f02 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1143 microversion: 2.1 time: 0.085460 Jul 28 04:06:33.952489 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2c491d63-b4f6-4cdb-b521-be19060e81aa tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572da9700>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:33.952660 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 464/908] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:33 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:34.036224 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2c491d63-b4f6-4cdb-b521-be19060e81aa tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 200 len: 344 microversion: 2.1 time: 0.087708 Jul 28 04:06:34.036902 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 445/909] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:33 2022] GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 344 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:34.973604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-320e17b6-72ee-4c12-8fd0-16159abb9d06 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:34.974229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-320e17b6-72ee-4c12-8fd0-16159abb9d06 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:34.981876 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-320e17b6-72ee-4c12-8fd0-16159abb9d06 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:34.982400 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-320e17b6-72ee-4c12-8fd0-16159abb9d06 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:34.983145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-320e17b6-72ee-4c12-8fd0-16159abb9d06 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:34.983590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-320e17b6-72ee-4c12-8fd0-16159abb9d06 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:35.050901 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-320e17b6-72ee-4c12-8fd0-16159abb9d06 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:35.052706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-be1c537f-7879-40cf-a4a3-285ce99481c8 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572dc85e0>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:35.059706 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-320e17b6-72ee-4c12-8fd0-16159abb9d06 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1135 microversion: 2.1 time: 0.089954 Jul 28 04:06:35.060339 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 465/910] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:34 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1135 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:35.104166 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-be1c537f-7879-40cf-a4a3-285ce99481c8 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 200 len: 344 microversion: 2.1 time: 0.057054 Jul 28 04:06:35.104809 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 446/911] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:35 2022] GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:36.081597 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8587a1b6-d89f-40a2-8996-fea38a4734ff tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:36.082226 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8587a1b6-d89f-40a2-8996-fea38a4734ff tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:36.089910 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8587a1b6-d89f-40a2-8996-fea38a4734ff tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:36.090376 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8587a1b6-d89f-40a2-8996-fea38a4734ff tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:36.091177 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8587a1b6-d89f-40a2-8996-fea38a4734ff tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:36.091630 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8587a1b6-d89f-40a2-8996-fea38a4734ff tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:36.119915 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-bd15f0d4-2b32-4f66-ae42-e3d73a265b59 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572d58040>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:36.167974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8587a1b6-d89f-40a2-8996-fea38a4734ff tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:36.175852 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8587a1b6-d89f-40a2-8996-fea38a4734ff tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1191 microversion: 2.1 time: 0.098079 Jul 28 04:06:36.180180 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 466/912] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:36 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:36.180610 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-bd15f0d4-2b32-4f66-ae42-e3d73a265b59 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 200 len: 344 microversion: 2.1 time: 0.065687 Jul 28 04:06:36.181185 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 447/913] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:36 2022] GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:37.260520 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e5ea92bd-bfd3-4e1e-bd0a-67a6f4796f4a tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572f088b0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:37.263071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3b3c49af-95c0-4d48-bcc3-46d97588f5ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:37.263071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3b3c49af-95c0-4d48-bcc3-46d97588f5ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:37.263071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3b3c49af-95c0-4d48-bcc3-46d97588f5ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:37.263071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3b3c49af-95c0-4d48-bcc3-46d97588f5ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:37.263845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3b3c49af-95c0-4d48-bcc3-46d97588f5ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:37.263845 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3b3c49af-95c0-4d48-bcc3-46d97588f5ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:37.264054 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e5ea92bd-bfd3-4e1e-bd0a-67a6f4796f4a tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 200 len: 344 microversion: 2.1 time: 0.056266 Jul 28 04:06:37.264054 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 467/914] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:37 2022] GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:37.277280 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-3b3c49af-95c0-4d48-bcc3-46d97588f5ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:37.285113 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3b3c49af-95c0-4d48-bcc3-46d97588f5ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1191 microversion: 2.1 time: 0.091912 Jul 28 04:06:37.285690 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 448/915] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:37 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:38.263202 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-be761bf9-e82b-429f-88ae-7294b39726f8 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572dff940>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:38.307473 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a4cc7556-edab-4964-900e-14a8c422d435 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:38.308290 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a4cc7556-edab-4964-900e-14a8c422d435 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:38.314942 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a4cc7556-edab-4964-900e-14a8c422d435 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:38.315404 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a4cc7556-edab-4964-900e-14a8c422d435 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:38.316227 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a4cc7556-edab-4964-900e-14a8c422d435 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:38.316679 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a4cc7556-edab-4964-900e-14a8c422d435 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:38.324318 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-be761bf9-e82b-429f-88ae-7294b39726f8 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 200 len: 344 microversion: 2.1 time: 0.065749 Jul 28 04:06:38.324930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 468/916] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:38 2022] GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:38.381629 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a4cc7556-edab-4964-900e-14a8c422d435 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:38.391990 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a4cc7556-edab-4964-900e-14a8c422d435 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1191 microversion: 2.1 time: 0.088698 Jul 28 04:06:38.392633 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 449/917] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:38 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:39.345476 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fd4adbf1-92cd-4568-a372-3a4628401240 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572ec2430>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:39.427143 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d0ac9931-6094-46c1-aab1-ac42b9508eaa tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:39.427767 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d0ac9931-6094-46c1-aab1-ac42b9508eaa tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:39.435707 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0ac9931-6094-46c1-aab1-ac42b9508eaa tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:39.436320 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0ac9931-6094-46c1-aab1-ac42b9508eaa tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:39.437222 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0ac9931-6094-46c1-aab1-ac42b9508eaa tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:39.437775 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d0ac9931-6094-46c1-aab1-ac42b9508eaa tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:39.649755 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-fd4adbf1-92cd-4568-a372-3a4628401240 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] HTTP exception thrown: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fd4adbf1-92cd-4568-a372-3a4628401240 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Request method failure captured: Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a HTTP/1.1 Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gtBburPC-AwvNljlxxBoBbmAFLS08JnRTZvf1lQucvmiqIuFtyHjzE-tuPncL9Pi1cuUyFGPvgeVq0CCOAD5a1TeW-ms4g7YPvmvVdQV734ZtB2Gy79Wiuzy4ENP1aKGfHPOfHKwjLPncoDbcDz7FvhIK2ZCylWYcSw8mUsbVjl5U0 Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 4a0b6d12e9f04736a12af62214c0376d Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:06:39.653370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a0b6d12e9f04736a12af62214c0376d", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0b6d12e9f04736a12af62214c0376d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a0b6d12e9f04736a12af62214c0376d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0b6d12e9f04736a12af62214c0376d"}]}] Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 4a0b6d12e9f04736a12af62214c0376d Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-VolumesSnapshotsTestJSON-1903795320-project Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: aaade4058f354080904a83c19fd1ce68 Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1903795320-project Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': 'd8157b53-dfe4-40ed-8ee9-2adc95ffa15a'} Jul 28 04:06:39.656118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. (HTTP 404) (Request-ID: req-ecdb6516-ef84-404e-b83a-9787c0eaa8b8) Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:39.659940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:06:39.667604 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 04:06:39.669919 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fd4adbf1-92cd-4568-a372-3a4628401240 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Returning 404 to user: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fd4adbf1-92cd-4568-a372-3a4628401240 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 404 len: 109 microversion: 2.1 time: 0.320090 Jul 28 04:06:39.672615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 469/918] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:39 2022] GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 109 bytes in 322 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:39.701884 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8755443f-16a5-4a77-8eb8-78165e2a290c tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572f124c0>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:39.713482 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d0ac9931-6094-46c1-aab1-ac42b9508eaa tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:39.725660 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d0ac9931-6094-46c1-aab1-ac42b9508eaa tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1277 microversion: 2.1 time: 0.302239 Jul 28 04:06:39.727052 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 450/919] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:39 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1277 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:39.783020 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-8755443f-16a5-4a77-8eb8-78165e2a290c tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] HTTP exception thrown: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8755443f-16a5-4a77-8eb8-78165e2a290c tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Request method failure captured: Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: DELETE /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a HTTP/1.1 Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gtBburPC-AwvNljlxxBoBbmAFLS08JnRTZvf1lQucvmiqIuFtyHjzE-tuPncL9Pi1cuUyFGPvgeVq0CCOAD5a1TeW-ms4g7YPvmvVdQV734ZtB2Gy79Wiuzy4ENP1aKGfHPOfHKwjLPncoDbcDz7FvhIK2ZCylWYcSw8mUsbVjl5U0 Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 4a0b6d12e9f04736a12af62214c0376d Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:06:39.785511 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a0b6d12e9f04736a12af62214c0376d", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0b6d12e9f04736a12af62214c0376d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a0b6d12e9f04736a12af62214c0376d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0b6d12e9f04736a12af62214c0376d"}]}] Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 4a0b6d12e9f04736a12af62214c0376d Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-VolumesSnapshotsTestJSON-1903795320-project Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: aaade4058f354080904a83c19fd1ce68 Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1903795320-project Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': 'd8157b53-dfe4-40ed-8ee9-2adc95ffa15a'} Jul 28 04:06:39.787892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. (HTTP 404) (Request-ID: req-f7aba245-f96e-4999-a560-c843fe1d0b75) Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:39.788762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 04:06:39.789894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 04:06:39.792999 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8755443f-16a5-4a77-8eb8-78165e2a290c tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Returning 404 to user: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:39.806064 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8755443f-16a5-4a77-8eb8-78165e2a290c tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 404 len: 109 microversion: 2.1 time: 0.110719 Jul 28 04:06:39.807767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 470/920] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Jul 28 04:06:39 2022] DELETE /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:39.807860 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6719c26f-afaf-4803-8092-91297a16b192 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Calling method '.version_select at 0x7f5572e5d160>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:39.845197 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-6719c26f-afaf-4803-8092-91297a16b192 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] HTTP exception thrown: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6719c26f-afaf-4803-8092-91297a16b192 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Request method failure captured: Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a HTTP/1.1 Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gtBburPC-AwvNljlxxBoBbmAFLS08JnRTZvf1lQucvmiqIuFtyHjzE-tuPncL9Pi1cuUyFGPvgeVq0CCOAD5a1TeW-ms4g7YPvmvVdQV734ZtB2Gy79Wiuzy4ENP1aKGfHPOfHKwjLPncoDbcDz7FvhIK2ZCylWYcSw8mUsbVjl5U0 Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 4a0b6d12e9f04736a12af62214c0376d Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:06:39.847714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a0b6d12e9f04736a12af62214c0376d", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0b6d12e9f04736a12af62214c0376d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a0b6d12e9f04736a12af62214c0376d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0b6d12e9f04736a12af62214c0376d"}]}] Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 4a0b6d12e9f04736a12af62214c0376d Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1903795320 Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-VolumesSnapshotsTestJSON-1903795320-project Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: aaade4058f354080904a83c19fd1ce68 Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1903795320-project Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': 'd8157b53-dfe4-40ed-8ee9-2adc95ffa15a'} Jul 28 04:06:39.850200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. (HTTP 404) (Request-ID: req-8b08c1b7-6cf7-4358-99fb-5ab1b8c133a3) Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:39.851293 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:06:39.852471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 04:06:39.854541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6719c26f-afaf-4803-8092-91297a16b192 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] Returning 404 to user: Volume d8157b53-dfe4-40ed-8ee9-2adc95ffa15a could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6719c26f-afaf-4803-8092-91297a16b192 tempest-VolumesSnapshotsTestJSON-1903795320 tempest-VolumesSnapshotsTestJSON-1903795320-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a" status: 404 len: 109 microversion: 2.1 time: 0.056760 Jul 28 04:06:39.855684 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 451/921] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:39 2022] GET /compute/v2.1/os-volumes/d8157b53-dfe4-40ed-8ee9-2adc95ffa15a => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:40.755497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-99b347a9-b703-4e68-9457-1a863a58023a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:40.756169 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-99b347a9-b703-4e68-9457-1a863a58023a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:40.763784 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-99b347a9-b703-4e68-9457-1a863a58023a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:40.764212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-99b347a9-b703-4e68-9457-1a863a58023a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:40.765079 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-99b347a9-b703-4e68-9457-1a863a58023a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:40.765535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-99b347a9-b703-4e68-9457-1a863a58023a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:40.918994 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:40.942137 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=6 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:40.975413 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-99b347a9-b703-4e68-9457-1a863a58023a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:40.990372 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-99b347a9-b703-4e68-9457-1a863a58023a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.239909 Jul 28 04:06:40.993451 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 471/922] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:40 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:41.141894 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-1c2483de-d41f-454b-bbc8-40db5838e92e req-c4a35414-e27a-4662-b42d-385538f79159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b0538a6-ada9-4f1f-b47c-1aa7b6678a62", "tag": "466b36f7-7bf9-400c-8d85-f37adcc930f6"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:41.167902 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-1c2483de-d41f-454b-bbc8-40db5838e92e req-c4a35414-e27a-4662-b42d-385538f79159 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:41.169436 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-1c2483de-d41f-454b-bbc8-40db5838e92e req-c4a35414-e27a-4662-b42d-385538f79159 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:41.182167 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-1c2483de-d41f-454b-bbc8-40db5838e92e req-c4a35414-e27a-4662-b42d-385538f79159 service nova] Creating event network-changed:466b36f7-7bf9-400c-8d85-f37adcc930f6 for instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 on hv-cinder-85127 Jul 28 04:06:41.188050 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-1c2483de-d41f-454b-bbc8-40db5838e92e req-c4a35414-e27a-4662-b42d-385538f79159 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057875 Jul 28 04:06:41.189038 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 452/923] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:42.015408 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2ec44fee-5fc5-4678-b1d5-d3cea5ca5dc5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:42.016203 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2ec44fee-5fc5-4678-b1d5-d3cea5ca5dc5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:42.024010 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2ec44fee-5fc5-4678-b1d5-d3cea5ca5dc5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:42.024722 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2ec44fee-5fc5-4678-b1d5-d3cea5ca5dc5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:42.025870 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2ec44fee-5fc5-4678-b1d5-d3cea5ca5dc5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:42.026319 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2ec44fee-5fc5-4678-b1d5-d3cea5ca5dc5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:42.193038 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2ec44fee-5fc5-4678-b1d5-d3cea5ca5dc5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:42.201928 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2ec44fee-5fc5-4678-b1d5-d3cea5ca5dc5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.191501 Jul 28 04:06:42.202453 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 472/924] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:42 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:43.220679 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=4 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:43.224863 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a31f902e-20d4-472f-952e-70ec5ccd381d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:43.225570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a31f902e-20d4-472f-952e-70ec5ccd381d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:43.231835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a31f902e-20d4-472f-952e-70ec5ccd381d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:43.232347 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a31f902e-20d4-472f-952e-70ec5ccd381d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:43.233134 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a31f902e-20d4-472f-952e-70ec5ccd381d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:43.233578 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a31f902e-20d4-472f-952e-70ec5ccd381d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:43.394673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a31f902e-20d4-472f-952e-70ec5ccd381d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:43.403386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a31f902e-20d4-472f-952e-70ec5ccd381d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.184120 Jul 28 04:06:43.404032 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 453/925] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:43 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:44.424573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a1aaffa8-d6b4-4313-b889-3bb28f5742d6 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:44.425187 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a1aaffa8-d6b4-4313-b889-3bb28f5742d6 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:44.432157 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a1aaffa8-d6b4-4313-b889-3bb28f5742d6 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:44.432698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a1aaffa8-d6b4-4313-b889-3bb28f5742d6 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:44.433582 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a1aaffa8-d6b4-4313-b889-3bb28f5742d6 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:44.434031 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a1aaffa8-d6b4-4313-b889-3bb28f5742d6 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:44.620916 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a1aaffa8-d6b4-4313-b889-3bb28f5742d6 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:44.629536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a1aaffa8-d6b4-4313-b889-3bb28f5742d6 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.208684 Jul 28 04:06:44.630117 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 473/926] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:44 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:45.651708 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-cf6e1c00-95f2-4dd4-a508-78cf2cda13c8 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:45.652778 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-cf6e1c00-95f2-4dd4-a508-78cf2cda13c8 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:45.661599 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c00-95f2-4dd4-a508-78cf2cda13c8 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:45.662047 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c00-95f2-4dd4-a508-78cf2cda13c8 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:45.662827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c00-95f2-4dd4-a508-78cf2cda13c8 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:45.663298 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-cf6e1c00-95f2-4dd4-a508-78cf2cda13c8 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:45.828986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-cf6e1c00-95f2-4dd4-a508-78cf2cda13c8 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:45.838975 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-cf6e1c00-95f2-4dd4-a508-78cf2cda13c8 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.191679 Jul 28 04:06:45.839667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 454/927] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:45 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:46.859316 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-26ee73b4-c175-4050-bf51-291ce282d8c2 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:46.859932 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-26ee73b4-c175-4050-bf51-291ce282d8c2 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:46.866694 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-26ee73b4-c175-4050-bf51-291ce282d8c2 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:46.867153 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-26ee73b4-c175-4050-bf51-291ce282d8c2 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:46.867979 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-26ee73b4-c175-4050-bf51-291ce282d8c2 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:46.868426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-26ee73b4-c175-4050-bf51-291ce282d8c2 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:47.007199 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-26ee73b4-c175-4050-bf51-291ce282d8c2 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:47.015746 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-26ee73b4-c175-4050-bf51-291ce282d8c2 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.160327 Jul 28 04:06:47.016351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 474/928] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:46 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:48.037236 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-25e0a9e3-d4ab-41be-9142-9de3faeb4b7c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:48.038519 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-25e0a9e3-d4ab-41be-9142-9de3faeb4b7c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:48.047049 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-25e0a9e3-d4ab-41be-9142-9de3faeb4b7c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:48.047501 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-25e0a9e3-d4ab-41be-9142-9de3faeb4b7c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:48.048332 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-25e0a9e3-d4ab-41be-9142-9de3faeb4b7c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:48.048770 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-25e0a9e3-d4ab-41be-9142-9de3faeb4b7c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:48.221692 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-25e0a9e3-d4ab-41be-9142-9de3faeb4b7c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:48.230768 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-25e0a9e3-d4ab-41be-9142-9de3faeb4b7c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.197340 Jul 28 04:06:48.231345 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 455/929] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:48 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:49.257764 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1519da7b-19f6-44b5-b6b9-ca00865b98f4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:49.258382 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1519da7b-19f6-44b5-b6b9-ca00865b98f4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:49.264938 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1519da7b-19f6-44b5-b6b9-ca00865b98f4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:49.265483 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1519da7b-19f6-44b5-b6b9-ca00865b98f4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:49.266278 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1519da7b-19f6-44b5-b6b9-ca00865b98f4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:49.266723 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1519da7b-19f6-44b5-b6b9-ca00865b98f4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:49.410826 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1519da7b-19f6-44b5-b6b9-ca00865b98f4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:49.419791 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1519da7b-19f6-44b5-b6b9-ca00865b98f4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.166141 Jul 28 04:06:49.420489 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 475/930] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:49 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:50.441380 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c9826365-2116-40e5-9fa2-65b4be7bf7db tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:50.442010 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c9826365-2116-40e5-9fa2-65b4be7bf7db tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:50.450071 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c9826365-2116-40e5-9fa2-65b4be7bf7db tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:50.450793 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c9826365-2116-40e5-9fa2-65b4be7bf7db tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:50.451330 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c9826365-2116-40e5-9fa2-65b4be7bf7db tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:50.451779 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c9826365-2116-40e5-9fa2-65b4be7bf7db tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:50.596457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c9826365-2116-40e5-9fa2-65b4be7bf7db tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:50.604955 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c9826365-2116-40e5-9fa2-65b4be7bf7db tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.167423 Jul 28 04:06:50.605551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 456/931] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:50 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:51.626973 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b271fe0e-873e-4adb-bd0c-70ea6bed1687 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:51.627590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b271fe0e-873e-4adb-bd0c-70ea6bed1687 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:51.634389 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b271fe0e-873e-4adb-bd0c-70ea6bed1687 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:51.635456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b271fe0e-873e-4adb-bd0c-70ea6bed1687 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:51.636364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b271fe0e-873e-4adb-bd0c-70ea6bed1687 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:51.636814 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b271fe0e-873e-4adb-bd0c-70ea6bed1687 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:51.778157 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b271fe0e-873e-4adb-bd0c-70ea6bed1687 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:51.786533 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b271fe0e-873e-4adb-bd0c-70ea6bed1687 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.163294 Jul 28 04:06:51.786974 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 476/932] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:51 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:52.808850 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e5357ab9-af00-47bd-8e76-e3324414371a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:52.809594 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e5357ab9-af00-47bd-8e76-e3324414371a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:52.815981 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5357ab9-af00-47bd-8e76-e3324414371a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:52.816456 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5357ab9-af00-47bd-8e76-e3324414371a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:52.817311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5357ab9-af00-47bd-8e76-e3324414371a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:52.817865 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5357ab9-af00-47bd-8e76-e3324414371a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:52.974102 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e5357ab9-af00-47bd-8e76-e3324414371a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:52.982048 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e5357ab9-af00-47bd-8e76-e3324414371a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.178133 Jul 28 04:06:52.982634 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 457/933] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:52 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:54.002992 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9243f758-4a8c-494a-a9be-4b1127c2485e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:54.005761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9243f758-4a8c-494a-a9be-4b1127c2485e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:54.010347 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9243f758-4a8c-494a-a9be-4b1127c2485e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:54.010794 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9243f758-4a8c-494a-a9be-4b1127c2485e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:54.011565 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9243f758-4a8c-494a-a9be-4b1127c2485e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:54.012024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9243f758-4a8c-494a-a9be-4b1127c2485e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:54.147698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9243f758-4a8c-494a-a9be-4b1127c2485e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:54.156241 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9243f758-4a8c-494a-a9be-4b1127c2485e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.157054 Jul 28 04:06:54.156825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 477/934] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:53 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:55.177218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0d23e2ca-abca-4ea0-a560-0409971f2b77 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:55.177857 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0d23e2ca-abca-4ea0-a560-0409971f2b77 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:55.185215 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d23e2ca-abca-4ea0-a560-0409971f2b77 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:55.185664 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d23e2ca-abca-4ea0-a560-0409971f2b77 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:55.186468 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d23e2ca-abca-4ea0-a560-0409971f2b77 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:55.186905 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0d23e2ca-abca-4ea0-a560-0409971f2b77 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:55.325119 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0d23e2ca-abca-4ea0-a560-0409971f2b77 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:55.333112 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0d23e2ca-abca-4ea0-a560-0409971f2b77 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.159717 Jul 28 04:06:55.333682 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 458/935] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:55 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:56.359714 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2a628763-eae5-4c61-97ae-0b7d70a5d865 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:56.360980 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2a628763-eae5-4c61-97ae-0b7d70a5d865 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:56.373272 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2a628763-eae5-4c61-97ae-0b7d70a5d865 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:56.374249 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2a628763-eae5-4c61-97ae-0b7d70a5d865 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:56.375538 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2a628763-eae5-4c61-97ae-0b7d70a5d865 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:56.376388 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2a628763-eae5-4c61-97ae-0b7d70a5d865 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:56.519924 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-bbb64013-4125-4e07-a37c-59a9210ac22f req-64641fb4-09eb-4d91-a911-066b8310e6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0538a6-ada9-4f1f-b47c-1aa7b6678a62", "name": "network-vif-plugged", "status": "completed", "tag": "466b36f7-7bf9-400c-8d85-f37adcc930f6"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:56.530542 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-bbb64013-4125-4e07-a37c-59a9210ac22f req-64641fb4-09eb-4d91-a911-066b8310e6eb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:56.530990 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-bbb64013-4125-4e07-a37c-59a9210ac22f req-64641fb4-09eb-4d91-a911-066b8310e6eb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:56.543253 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-bbb64013-4125-4e07-a37c-59a9210ac22f req-64641fb4-09eb-4d91-a911-066b8310e6eb service nova] Creating event network-vif-plugged:466b36f7-7bf9-400c-8d85-f37adcc930f6 for instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 on hv-cinder-85127 Jul 28 04:06:56.549345 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-bbb64013-4125-4e07-a37c-59a9210ac22f req-64641fb4-09eb-4d91-a911-066b8310e6eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032938 Jul 28 04:06:56.553348 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 459/936] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:56.567678 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2a628763-eae5-4c61-97ae-0b7d70a5d865 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:56.577177 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2a628763-eae5-4c61-97ae-0b7d70a5d865 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.225660 Jul 28 04:06:56.577850 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 478/937] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:56 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:57.599763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-122016b1-4b89-4b2b-aa8c-32d7fad0ca3e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:57.600606 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-122016b1-4b89-4b2b-aa8c-32d7fad0ca3e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:57.607133 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-122016b1-4b89-4b2b-aa8c-32d7fad0ca3e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:57.607597 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-122016b1-4b89-4b2b-aa8c-32d7fad0ca3e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:57.608420 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-122016b1-4b89-4b2b-aa8c-32d7fad0ca3e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:57.608865 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-122016b1-4b89-4b2b-aa8c-32d7fad0ca3e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:57.763545 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-122016b1-4b89-4b2b-aa8c-32d7fad0ca3e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:57.776499 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-122016b1-4b89-4b2b-aa8c-32d7fad0ca3e tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1265 microversion: 2.1 time: 0.181134 Jul 28 04:06:57.777034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 460/938] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:57 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:58.798279 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4c05164a-eb1c-4d14-8dee-89e6b1436fac tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:58.798987 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4c05164a-eb1c-4d14-8dee-89e6b1436fac tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:58.805697 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4c05164a-eb1c-4d14-8dee-89e6b1436fac tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:58.806151 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4c05164a-eb1c-4d14-8dee-89e6b1436fac tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:58.807046 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4c05164a-eb1c-4d14-8dee-89e6b1436fac tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:58.807485 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4c05164a-eb1c-4d14-8dee-89e6b1436fac tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:58.939196 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4c05164a-eb1c-4d14-8dee-89e6b1436fac tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:58.941471 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=73 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:58.947933 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4c05164a-eb1c-4d14-8dee-89e6b1436fac tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1451 microversion: 2.1 time: 0.153671 Jul 28 04:06:58.948528 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 479/939] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:58 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:58.968474 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ee4aa5b4-393a-4ce2-b93e-b31f80385349 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:58.969090 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ee4aa5b4-393a-4ce2-b93e-b31f80385349 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:58.975625 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ee4aa5b4-393a-4ce2-b93e-b31f80385349 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:58.976115 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ee4aa5b4-393a-4ce2-b93e-b31f80385349 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:58.976888 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ee4aa5b4-393a-4ce2-b93e-b31f80385349 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:58.977331 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ee4aa5b4-393a-4ce2-b93e-b31f80385349 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:59.118691 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ee4aa5b4-393a-4ce2-b93e-b31f80385349 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:59.126667 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ee4aa5b4-393a-4ce2-b93e-b31f80385349 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1451 microversion: 2.1 time: 0.162029 Jul 28 04:06:59.127230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 461/940] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:58 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:02.134814 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-254cf544-ba48-49b6-b597-85a16202868c req-d241fd46-981c-4693-a655-450fe2cbb199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b0538a6-ada9-4f1f-b47c-1aa7b6678a62", "tag": "466b36f7-7bf9-400c-8d85-f37adcc930f6"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:02.142635 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:02.147678 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-254cf544-ba48-49b6-b597-85a16202868c req-d241fd46-981c-4693-a655-450fe2cbb199 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:02.148180 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-254cf544-ba48-49b6-b597-85a16202868c req-d241fd46-981c-4693-a655-450fe2cbb199 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:02.161193 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-254cf544-ba48-49b6-b597-85a16202868c req-d241fd46-981c-4693-a655-450fe2cbb199 service nova] Creating event network-changed:466b36f7-7bf9-400c-8d85-f37adcc930f6 for instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 on hv-cinder-85127 Jul 28 04:07:02.166709 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-254cf544-ba48-49b6-b597-85a16202868c req-d241fd46-981c-4693-a655-450fe2cbb199 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036281 Jul 28 04:07:02.167332 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 480/941] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:17.804056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1781211290", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "networks": [{"uuid": "d95435be-155f-4499-b5b6-5836f17886d6"}]}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:17.814297 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=34 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:17.814297 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=70 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:17.864441 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.network.neutron [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] validate_networks() for [('d95435be-155f-4499-b5b6-5836f17886d6', None, None, None, None, None)] {{(pid=135704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:07:18.296405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Flavor limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:07:18.296840 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Image limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:07:18.297341 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Flavor pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:07:18.297778 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Image pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:07:18.298191 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:07:18.307093 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:18.307549 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:18.308453 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:18.308893 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:18.326948 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Getting quotas for project 83b3cf737ddd463f8f77ebe29d23fc7e. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:07:18.331410 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Getting quotas for user 329f18c8b60541a18d61a467a74d592a and project 83b3cf737ddd463f8f77ebe29d23fc7e. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:07:18.343023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Going to run 1 instances... {{(pid=135704) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:07:18.345405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:07:18.468083 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1664ecb2-19d8-4a7d-b22d-fe647a7dd2e1 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667827 Jul 28 04:07:18.468762 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 462/942] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:07:18.480749 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d25d77ec-3f0e-48f5-9d9f-aa7dbd370851 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:18.481492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d25d77ec-3f0e-48f5-9d9f-aa7dbd370851 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:18.485502 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:18.548513 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d25d77ec-3f0e-48f5-9d9f-aa7dbd370851 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:18.569017 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d25d77ec-3f0e-48f5-9d9f-aa7dbd370851 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1219 microversion: 2.1 time: 0.084289 Jul 28 04:07:18.569017 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 481/943] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:18 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:19.583931 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-19045e3b-792c-44d9-a4f0-6e066912376c tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:19.584646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-19045e3b-792c-44d9-a4f0-6e066912376c tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:19.640086 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-19045e3b-792c-44d9-a4f0-6e066912376c tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:19.647208 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-19045e3b-792c-44d9-a4f0-6e066912376c tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1219 microversion: 2.1 time: 0.067900 Jul 28 04:07:19.647791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 463/944] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:19 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:20.668516 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-469e529c-e329-411e-bc4b-000e012164cf tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:20.669874 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-469e529c-e329-411e-bc4b-000e012164cf tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:20.677207 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-469e529c-e329-411e-bc4b-000e012164cf tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:20.677673 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-469e529c-e329-411e-bc4b-000e012164cf tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:20.678468 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-469e529c-e329-411e-bc4b-000e012164cf tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:20.678917 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-469e529c-e329-411e-bc4b-000e012164cf tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:20.744446 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-469e529c-e329-411e-bc4b-000e012164cf tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:20.753183 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-469e529c-e329-411e-bc4b-000e012164cf tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1271 microversion: 2.1 time: 0.088608 Jul 28 04:07:20.753783 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 482/945] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:20 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:21.774887 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-43bb365d-ac58-4bdf-8ec9-b84ff9c0ad0a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:21.775793 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-43bb365d-ac58-4bdf-8ec9-b84ff9c0ad0a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:21.785433 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-43bb365d-ac58-4bdf-8ec9-b84ff9c0ad0a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:21.785888 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-43bb365d-ac58-4bdf-8ec9-b84ff9c0ad0a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:21.786737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-43bb365d-ac58-4bdf-8ec9-b84ff9c0ad0a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:21.787232 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-43bb365d-ac58-4bdf-8ec9-b84ff9c0ad0a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:21.874218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-43bb365d-ac58-4bdf-8ec9-b84ff9c0ad0a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:21.883374 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-43bb365d-ac58-4bdf-8ec9-b84ff9c0ad0a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1277 microversion: 2.1 time: 0.112868 Jul 28 04:07:21.884394 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 464/946] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:21 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:22.910825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6b6230f6-a108-40d7-a220-16abffd29fb6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:22.911309 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6b6230f6-a108-40d7-a220-16abffd29fb6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:22.922665 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b6230f6-a108-40d7-a220-16abffd29fb6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:22.925794 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b6230f6-a108-40d7-a220-16abffd29fb6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:22.925794 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b6230f6-a108-40d7-a220-16abffd29fb6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:22.925794 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6b6230f6-a108-40d7-a220-16abffd29fb6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:23.073266 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6b6230f6-a108-40d7-a220-16abffd29fb6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:23.082506 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6b6230f6-a108-40d7-a220-16abffd29fb6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1319 microversion: 2.1 time: 0.175867 Jul 28 04:07:23.083085 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 483/947] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:22 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:23.183912 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-3047a31f-d504-469f-8b0e-6336c15d0c0f req-ad5a56cb-c440-4e65-b57d-ac1575acc178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c65d71-b715-4c1a-860b-75fd32e26f3a", "tag": "e0d80004-385b-4f90-9bd2-6b9861e7c00c"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:23.196267 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-3047a31f-d504-469f-8b0e-6336c15d0c0f req-ad5a56cb-c440-4e65-b57d-ac1575acc178 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:23.196985 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-3047a31f-d504-469f-8b0e-6336c15d0c0f req-ad5a56cb-c440-4e65-b57d-ac1575acc178 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:23.210334 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-3047a31f-d504-469f-8b0e-6336c15d0c0f req-ad5a56cb-c440-4e65-b57d-ac1575acc178 service nova] Creating event network-changed:e0d80004-385b-4f90-9bd2-6b9861e7c00c for instance e7c65d71-b715-4c1a-860b-75fd32e26f3a on hv-cinder-85127 Jul 28 04:07:23.215937 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-3047a31f-d504-469f-8b0e-6336c15d0c0f req-ad5a56cb-c440-4e65-b57d-ac1575acc178 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037771 Jul 28 04:07:23.216687 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 465/948] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:24.106470 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-007e133e-ba9f-4519-96b3-83bb75690c54 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:24.108458 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-007e133e-ba9f-4519-96b3-83bb75690c54 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:24.121194 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-007e133e-ba9f-4519-96b3-83bb75690c54 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:24.122307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-007e133e-ba9f-4519-96b3-83bb75690c54 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:24.124112 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-007e133e-ba9f-4519-96b3-83bb75690c54 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:24.124913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-007e133e-ba9f-4519-96b3-83bb75690c54 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:24.306040 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-007e133e-ba9f-4519-96b3-83bb75690c54 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:24.314492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-007e133e-ba9f-4519-96b3-83bb75690c54 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1319 microversion: 2.1 time: 0.213978 Jul 28 04:07:24.315076 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 484/949] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:24 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:25.335833 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-52a10d6e-88eb-4f4d-b507-67d36ff7d92f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:25.336564 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-52a10d6e-88eb-4f4d-b507-67d36ff7d92f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:25.357878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-52a10d6e-88eb-4f4d-b507-67d36ff7d92f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:25.357878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-52a10d6e-88eb-4f4d-b507-67d36ff7d92f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:25.357878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-52a10d6e-88eb-4f4d-b507-67d36ff7d92f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:25.357878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-52a10d6e-88eb-4f4d-b507-67d36ff7d92f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:25.673943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-52a10d6e-88eb-4f4d-b507-67d36ff7d92f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:25.680500 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-52a10d6e-88eb-4f4d-b507-67d36ff7d92f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1319 microversion: 2.1 time: 0.349190 Jul 28 04:07:25.681070 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 466/950] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:25 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:26.703220 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4b6d098b-ed88-4971-922b-a820d77c8628 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:26.703839 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4b6d098b-ed88-4971-922b-a820d77c8628 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:26.710578 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4b6d098b-ed88-4971-922b-a820d77c8628 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:26.711040 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4b6d098b-ed88-4971-922b-a820d77c8628 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:26.711836 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4b6d098b-ed88-4971-922b-a820d77c8628 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:26.712307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4b6d098b-ed88-4971-922b-a820d77c8628 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:26.869005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4b6d098b-ed88-4971-922b-a820d77c8628 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:26.879028 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4b6d098b-ed88-4971-922b-a820d77c8628 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1319 microversion: 2.1 time: 0.180136 Jul 28 04:07:26.883077 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 485/951] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:26 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:27.901770 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6e41d89b-06b1-4f1e-8505-a28be0a6e320 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:27.902503 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6e41d89b-06b1-4f1e-8505-a28be0a6e320 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:27.910077 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6e41d89b-06b1-4f1e-8505-a28be0a6e320 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:27.910570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6e41d89b-06b1-4f1e-8505-a28be0a6e320 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:27.911878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6e41d89b-06b1-4f1e-8505-a28be0a6e320 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:27.912361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6e41d89b-06b1-4f1e-8505-a28be0a6e320 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:28.060735 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6e41d89b-06b1-4f1e-8505-a28be0a6e320 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:28.060735 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6e41d89b-06b1-4f1e-8505-a28be0a6e320 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1319 microversion: 2.1 time: 0.158494 Jul 28 04:07:28.060735 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 467/952] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:27 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:28.564536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-13d72aeb-2ad1-44e3-9ba7-ace8fbc54a28 req-70eb9d54-08e6-4031-ae32-1677c9c2d373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c65d71-b715-4c1a-860b-75fd32e26f3a", "name": "network-vif-plugged", "status": "completed", "tag": "e0d80004-385b-4f90-9bd2-6b9861e7c00c"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:28.571600 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:28.577829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-13d72aeb-2ad1-44e3-9ba7-ace8fbc54a28 req-70eb9d54-08e6-4031-ae32-1677c9c2d373 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:28.578284 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-13d72aeb-2ad1-44e3-9ba7-ace8fbc54a28 req-70eb9d54-08e6-4031-ae32-1677c9c2d373 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:28.593749 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-13d72aeb-2ad1-44e3-9ba7-ace8fbc54a28 req-70eb9d54-08e6-4031-ae32-1677c9c2d373 service nova] Creating event network-vif-plugged:e0d80004-385b-4f90-9bd2-6b9861e7c00c for instance e7c65d71-b715-4c1a-860b-75fd32e26f3a on hv-cinder-85127 Jul 28 04:07:28.595909 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-13d72aeb-2ad1-44e3-9ba7-ace8fbc54a28 req-70eb9d54-08e6-4031-ae32-1677c9c2d373 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035901 Jul 28 04:07:28.596841 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 486/953] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:29.086092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-a7a77d84-958d-4196-9ac2-48032b89cc0e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:29.086812 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-a7a77d84-958d-4196-9ac2-48032b89cc0e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:29.089236 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:29.095697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a7a77d84-958d-4196-9ac2-48032b89cc0e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:29.096251 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a7a77d84-958d-4196-9ac2-48032b89cc0e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:29.096989 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a7a77d84-958d-4196-9ac2-48032b89cc0e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:29.097435 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-a7a77d84-958d-4196-9ac2-48032b89cc0e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:29.261283 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-a7a77d84-958d-4196-9ac2-48032b89cc0e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:29.273111 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-a7a77d84-958d-4196-9ac2-48032b89cc0e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1319 microversion: 2.1 time: 0.190908 Jul 28 04:07:29.273916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 468/954] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:29 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:30.297183 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7b1b6218-4a16-46b2-ab28-a18f944a7c71 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:30.297975 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7b1b6218-4a16-46b2-ab28-a18f944a7c71 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:30.304540 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7b1b6218-4a16-46b2-ab28-a18f944a7c71 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:30.305063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7b1b6218-4a16-46b2-ab28-a18f944a7c71 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:30.312281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7b1b6218-4a16-46b2-ab28-a18f944a7c71 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:30.312281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7b1b6218-4a16-46b2-ab28-a18f944a7c71 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:30.448373 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7b1b6218-4a16-46b2-ab28-a18f944a7c71 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:30.462945 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7b1b6218-4a16-46b2-ab28-a18f944a7c71 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1319 microversion: 2.1 time: 0.171431 Jul 28 04:07:30.464250 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 487/955] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:30 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:31.487106 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-4f85c6cc-8e98-4165-9c15-85e2208a0f82 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:31.487750 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-4f85c6cc-8e98-4165-9c15-85e2208a0f82 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:31.490456 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=8 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:31.496011 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4f85c6cc-8e98-4165-9c15-85e2208a0f82 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:31.496540 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4f85c6cc-8e98-4165-9c15-85e2208a0f82 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:31.498274 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4f85c6cc-8e98-4165-9c15-85e2208a0f82 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:31.498675 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-4f85c6cc-8e98-4165-9c15-85e2208a0f82 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:31.646551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-4f85c6cc-8e98-4165-9c15-85e2208a0f82 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:31.655388 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-4f85c6cc-8e98-4165-9c15-85e2208a0f82 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1508 microversion: 2.1 time: 0.172307 Jul 28 04:07:31.655971 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 469/956] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:31 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:50.635807 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-50281b40-d769-4622-9718-ed008d08505e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4fe77c9-5a82-4c89-9661-e2d3338b09a6", "device": "/dev/sdb"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:50.638684 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-50281b40-d769-4622-9718-ed008d08505e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:50.641239 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=17 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:50.641924 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=32 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:50.647088 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-50281b40-d769-4622-9718-ed008d08505e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.647573 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-50281b40-d769-4622-9718-ed008d08505e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.648417 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-50281b40-d769-4622-9718-ed008d08505e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.648858 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-50281b40-d769-4622-9718-ed008d08505e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:51.505925 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-50281b40-d769-4622-9718-ed008d08505e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "POST /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873709 Jul 28 04:07:51.506640 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 488/957] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:07:50 2022] POST /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:21.700198 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e59d86a7-1bbd-437a-8bfe-6c27f0dcbc88 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:21.701640 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e59d86a7-1bbd-437a-8bfe-6c27f0dcbc88 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:21.703924 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:21.705287 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=34 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:21.711022 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e59d86a7-1bbd-437a-8bfe-6c27f0dcbc88 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:21.711490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e59d86a7-1bbd-437a-8bfe-6c27f0dcbc88 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:21.712317 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e59d86a7-1bbd-437a-8bfe-6c27f0dcbc88 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:21.712937 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e59d86a7-1bbd-437a-8bfe-6c27f0dcbc88 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:21.809609 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-e59d86a7-1bbd-437a-8bfe-6c27f0dcbc88 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lazy-loading 'services' on Instance uuid e7c65d71-b715-4c1a-860b-75fd32e26f3a {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:08:22.066030 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e59d86a7-1bbd-437a-8bfe-6c27f0dcbc88 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a/os-volume_attachments/a4fe77c9-5a82-4c89-9661-e2d3338b09a6" status: 202 len: 0 microversion: 2.1 time: 0.379336 Jul 28 04:08:22.067335 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 470/958] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:08:21 2022] DELETE /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a/os-volume_attachments/a4fe77c9-5a82-4c89-9661-e2d3338b09a6 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:08:23.225571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6edd17d9-eefb-46f4-af16-939d8cc54df8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:23.226360 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6edd17d9-eefb-46f4-af16-939d8cc54df8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:23.229035 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:23.229830 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:23.236666 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6edd17d9-eefb-46f4-af16-939d8cc54df8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:23.237197 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6edd17d9-eefb-46f4-af16-939d8cc54df8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:23.239687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6edd17d9-eefb-46f4-af16-939d8cc54df8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:23.239687 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6edd17d9-eefb-46f4-af16-939d8cc54df8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:23.269765 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6edd17d9-eefb-46f4-af16-939d8cc54df8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:08:23.627422 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6edd17d9-eefb-46f4-af16-939d8cc54df8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 204 len: 0 microversion: 2.1 time: 0.405105 Jul 28 04:08:23.628301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 489/959] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:08:23 2022] DELETE /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:08:23.638094 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7f0d2880-2355-4aed-a23f-2107f31c8ae6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:23.638809 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7f0d2880-2355-4aed-a23f-2107f31c8ae6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:23.645968 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7f0d2880-2355-4aed-a23f-2107f31c8ae6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:23.646434 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7f0d2880-2355-4aed-a23f-2107f31c8ae6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:23.647370 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7f0d2880-2355-4aed-a23f-2107f31c8ae6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:23.647837 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7f0d2880-2355-4aed-a23f-2107f31c8ae6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:23.835418 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7f0d2880-2355-4aed-a23f-2107f31c8ae6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:23.844030 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7f0d2880-2355-4aed-a23f-2107f31c8ae6 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1514 microversion: 2.1 time: 0.210785 Jul 28 04:08:23.844652 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 471/960] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:23 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:24.866654 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2588157f-97cb-43bf-9b13-a683fdc3ede5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:24.867402 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2588157f-97cb-43bf-9b13-a683fdc3ede5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:24.875044 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2588157f-97cb-43bf-9b13-a683fdc3ede5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:24.875503 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2588157f-97cb-43bf-9b13-a683fdc3ede5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:24.876434 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2588157f-97cb-43bf-9b13-a683fdc3ede5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:24.876878 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2588157f-97cb-43bf-9b13-a683fdc3ede5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:25.026113 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2588157f-97cb-43bf-9b13-a683fdc3ede5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:25.035187 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2588157f-97cb-43bf-9b13-a683fdc3ede5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1514 microversion: 2.1 time: 0.173219 Jul 28 04:08:25.035784 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 490/961] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:24 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:25.741461 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-d057a39e-ad35-4fc5-8f76-2bc5f12ff113 req-592d2562-db81-4336-800c-76777a7542e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c65d71-b715-4c1a-860b-75fd32e26f3a", "name": "network-vif-deleted", "tag": "e0d80004-385b-4f90-9bd2-6b9861e7c00c"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:25.755886 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-d057a39e-ad35-4fc5-8f76-2bc5f12ff113 req-592d2562-db81-4336-800c-76777a7542e9 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:25.756601 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-d057a39e-ad35-4fc5-8f76-2bc5f12ff113 req-592d2562-db81-4336-800c-76777a7542e9 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:25.773505 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-d057a39e-ad35-4fc5-8f76-2bc5f12ff113 req-592d2562-db81-4336-800c-76777a7542e9 service nova] Creating event network-vif-deleted:e0d80004-385b-4f90-9bd2-6b9861e7c00c for instance e7c65d71-b715-4c1a-860b-75fd32e26f3a on hv-cinder-85127 Jul 28 04:08:25.779428 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-d057a39e-ad35-4fc5-8f76-2bc5f12ff113 req-592d2562-db81-4336-800c-76777a7542e9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043473 Jul 28 04:08:25.780075 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 472/962] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:26.057333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:26.058794 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:26.071913 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:26.072763 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:26.074253 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:26.075044 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:26.115410 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:26.116036 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:26.116590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lazy-loading 'fault' on Instance uuid e7c65d71-b715-4c1a-860b-75fd32e26f3a {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:08:26.164753 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:26.178036 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9d6ab63e-4ff5-4414-a9c8-0586e9873e74 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 200 len: 1309 microversion: 2.1 time: 0.125113 Jul 28 04:08:26.179384 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 491/963] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:26 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:27.213816 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:27.215023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: e7c65d71-b715-4c1a-860b-75fd32e26f3a] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:27.224187 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:27.224765 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:27.229179 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:27.229179 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:27.243334 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] HTTP exception thrown: Instance e7c65d71-b715-4c1a-860b-75fd32e26f3a could not be found. Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Request method failure captured: Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a HTTP/1.1 Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gtxAuNck7InJehaLf0K8udGUt1CA2QH7l73WQyHWzhcnKzqkBOuYrscaNi7Ux_XDhtSibQ5vc2fBaKUQgKKwCRrgZDLlxoXpY3E2JfnQwyYnvtoJFTE-5osZLKBOUqwLlgQLrMIcJ6-g_zFXXA-z6nT-YLQTQy_zQs38gdweHW-Idg Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 83b3cf737ddd463f8f77ebe29d23fc7e Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-VolumesSnapshotTestJSON-362652760 Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:08:27.245056 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_83b3cf737ddd463f8f77ebe29d23fc7e", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/83b3cf737ddd463f8f77ebe29d23fc7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/83b3cf737ddd463f8f77ebe29d23fc7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/83b3cf737ddd463f8f77ebe29d23fc7e"}]}] Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-VolumesSnapshotTestJSON-362652760 Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 83b3cf737ddd463f8f77ebe29d23fc7e Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-362652760 Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-VolumesSnapshotTestJSON-362652760-project Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 329f18c8b60541a18d61a467a74d592a Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-VolumesSnapshotTestJSON-362652760-project Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance e7c65d71-b715-4c1a-860b-75fd32e26f3a could not be found. Jul 28 04:08:27.247502 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': 'e7c65d71-b715-4c1a-860b-75fd32e26f3a'} Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c65d71-b715-4c1a-860b-75fd32e26f3a could not be found. Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:08:27.248794 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c65d71-b715-4c1a-860b-75fd32e26f3a could not be found. Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c65d71-b715-4c1a-860b-75fd32e26f3a could not be found. Jul 28 04:08:27.250524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:08:27.252980 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Returning 404 to user: Instance e7c65d71-b715-4c1a-860b-75fd32e26f3a could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:08:27.252980 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-af5723a5-deba-4e0b-9b60-cebc833c8d73 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a" status: 404 len: 111 microversion: 2.1 time: 0.039072 Jul 28 04:08:27.252980 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 473/964] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:27 2022] GET /compute/v2.1/servers/e7c65d71-b715-4c1a-860b-75fd32e26f3a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:08:36.911935 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-606605635", "imageRef": "22b6e54f-23f3-4750-8a77-ef31732c6934", "flavorRef": "452", "networks": [{"uuid": "d95435be-155f-4499-b5b6-5836f17886d6"}]}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:36.920532 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:36.921199 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:36.974138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] validate_networks() for [('d95435be-155f-4499-b5b6-5836f17886d6', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:08:37.383820 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:08:37.384283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:08:37.384867 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:08:37.385279 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:08:37.385693 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:08:37.396321 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:37.396772 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:37.397576 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:37.398011 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:37.417089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Getting quotas for project 83b3cf737ddd463f8f77ebe29d23fc7e. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:08:37.421090 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Getting quotas for user 329f18c8b60541a18d61a467a74d592a and project 83b3cf737ddd463f8f77ebe29d23fc7e. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:08:37.433241 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:08:37.435602 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22b6e54f-23f3-4750-8a77-ef31732c6934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:08:37.589156 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-55189211-2da5-4577-82fa-718a55b36e55 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680822 Jul 28 04:08:37.589815 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 492/965] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:08:37.602616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9e041306-b083-4785-853c-42a6581bbafd tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:37.603570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9e041306-b083-4785-853c-42a6581bbafd tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:37.608200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=8 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:37.610905 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:37.686676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9e041306-b083-4785-853c-42a6581bbafd tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:37.696351 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9e041306-b083-4785-853c-42a6581bbafd tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1218 microversion: 2.1 time: 0.098375 Jul 28 04:08:37.701449 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 474/966] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:37 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:38.718185 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7618e39e-da80-4280-b565-c6cde4a2f352 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:38.718843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7618e39e-da80-4280-b565-c6cde4a2f352 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:38.726548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7618e39e-da80-4280-b565-c6cde4a2f352 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:38.726995 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7618e39e-da80-4280-b565-c6cde4a2f352 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:38.727776 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7618e39e-da80-4280-b565-c6cde4a2f352 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:38.728243 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7618e39e-da80-4280-b565-c6cde4a2f352 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:38.793063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7618e39e-da80-4280-b565-c6cde4a2f352 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:38.800871 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7618e39e-da80-4280-b565-c6cde4a2f352 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1222 microversion: 2.1 time: 0.087107 Jul 28 04:08:38.801449 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 493/967] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:38 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:39.822614 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-567dfcf2-a1a2-4a9e-b77c-ab980d48198a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:39.823238 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-567dfcf2-a1a2-4a9e-b77c-ab980d48198a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:39.831452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-567dfcf2-a1a2-4a9e-b77c-ab980d48198a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:39.833588 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-567dfcf2-a1a2-4a9e-b77c-ab980d48198a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:39.833588 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-567dfcf2-a1a2-4a9e-b77c-ab980d48198a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:39.833588 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-567dfcf2-a1a2-4a9e-b77c-ab980d48198a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:39.938925 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-567dfcf2-a1a2-4a9e-b77c-ab980d48198a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:39.955140 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-567dfcf2-a1a2-4a9e-b77c-ab980d48198a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1278 microversion: 2.1 time: 0.135806 Jul 28 04:08:39.956727 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 475/968] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:39 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:40.977104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-046ba2f0-d483-43a9-ba35-23a3f80758ad tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:40.977742 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-046ba2f0-d483-43a9-ba35-23a3f80758ad tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:40.985037 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-046ba2f0-d483-43a9-ba35-23a3f80758ad tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:40.985674 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-046ba2f0-d483-43a9-ba35-23a3f80758ad tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:40.986634 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-046ba2f0-d483-43a9-ba35-23a3f80758ad tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:40.987098 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-046ba2f0-d483-43a9-ba35-23a3f80758ad tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:41.145543 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-046ba2f0-d483-43a9-ba35-23a3f80758ad tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:41.154086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-046ba2f0-d483-43a9-ba35-23a3f80758ad tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1318 microversion: 2.1 time: 0.180822 Jul 28 04:08:41.154689 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 494/969] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:40 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:41.738099 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-6c93632f-3f17-42e9-b881-d790c109fafa req-34bd914d-a4b5-429f-8ae3-77987da53adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce2062d-983a-40bc-b219-6e28e56d39ed", "tag": "10ae9a7d-4659-46a5-a556-6df64f995b83"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:41.754414 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-6c93632f-3f17-42e9-b881-d790c109fafa req-34bd914d-a4b5-429f-8ae3-77987da53adf service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:41.755005 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-6c93632f-3f17-42e9-b881-d790c109fafa req-34bd914d-a4b5-429f-8ae3-77987da53adf service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:41.769970 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-6c93632f-3f17-42e9-b881-d790c109fafa req-34bd914d-a4b5-429f-8ae3-77987da53adf service nova] Creating event network-changed:10ae9a7d-4659-46a5-a556-6df64f995b83 for instance 0ce2062d-983a-40bc-b219-6e28e56d39ed on hv-cinder-85127 Jul 28 04:08:41.776092 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-6c93632f-3f17-42e9-b881-d790c109fafa req-34bd914d-a4b5-429f-8ae3-77987da53adf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042924 Jul 28 04:08:41.776706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 476/970] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:42.192148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f13f9ecf-41f8-4f8e-a5f2-52edb71dfaa5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:42.193697 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f13f9ecf-41f8-4f8e-a5f2-52edb71dfaa5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:42.206125 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f13f9ecf-41f8-4f8e-a5f2-52edb71dfaa5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.206903 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f13f9ecf-41f8-4f8e-a5f2-52edb71dfaa5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:42.208428 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f13f9ecf-41f8-4f8e-a5f2-52edb71dfaa5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.209209 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f13f9ecf-41f8-4f8e-a5f2-52edb71dfaa5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:42.395973 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f13f9ecf-41f8-4f8e-a5f2-52edb71dfaa5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:42.411060 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f13f9ecf-41f8-4f8e-a5f2-52edb71dfaa5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1318 microversion: 2.1 time: 0.223792 Jul 28 04:08:42.411819 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 495/971] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:42 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:43.434796 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-03b9cdf6-0a3d-40f2-b018-f45bcc16435a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:43.435442 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-03b9cdf6-0a3d-40f2-b018-f45bcc16435a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:43.442530 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-03b9cdf6-0a3d-40f2-b018-f45bcc16435a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:43.442996 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-03b9cdf6-0a3d-40f2-b018-f45bcc16435a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:43.443786 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-03b9cdf6-0a3d-40f2-b018-f45bcc16435a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:43.444360 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-03b9cdf6-0a3d-40f2-b018-f45bcc16435a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:43.592720 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-03b9cdf6-0a3d-40f2-b018-f45bcc16435a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:43.606386 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-03b9cdf6-0a3d-40f2-b018-f45bcc16435a tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1318 microversion: 2.1 time: 0.176104 Jul 28 04:08:43.607455 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 477/972] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:43 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:44.631225 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-af918cf8-30a2-4f1b-bce9-cafa7d474b5e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:44.631935 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-af918cf8-30a2-4f1b-bce9-cafa7d474b5e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:44.640957 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-af918cf8-30a2-4f1b-bce9-cafa7d474b5e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:44.641936 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-af918cf8-30a2-4f1b-bce9-cafa7d474b5e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:44.642747 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-af918cf8-30a2-4f1b-bce9-cafa7d474b5e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:44.643198 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-af918cf8-30a2-4f1b-bce9-cafa7d474b5e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:44.819235 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-af918cf8-30a2-4f1b-bce9-cafa7d474b5e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:44.827324 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-af918cf8-30a2-4f1b-bce9-cafa7d474b5e tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1318 microversion: 2.1 time: 0.202250 Jul 28 04:08:44.827988 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 496/973] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:44 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:45.850030 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f2a4a6ad-767f-4976-9165-44217f416fd5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:45.850676 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f2a4a6ad-767f-4976-9165-44217f416fd5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:45.858277 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2a4a6ad-767f-4976-9165-44217f416fd5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:45.858726 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2a4a6ad-767f-4976-9165-44217f416fd5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:45.859655 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2a4a6ad-767f-4976-9165-44217f416fd5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:45.860867 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-f2a4a6ad-767f-4976-9165-44217f416fd5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:46.227889 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f2a4a6ad-767f-4976-9165-44217f416fd5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:46.236449 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f2a4a6ad-767f-4976-9165-44217f416fd5 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1318 microversion: 2.1 time: 0.390428 Jul 28 04:08:46.237031 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 478/974] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:45 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:47.257174 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-447c48f9-0239-432f-8a94-77cc3d6f2ab0 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:47.258446 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-447c48f9-0239-432f-8a94-77cc3d6f2ab0 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:47.265393 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-447c48f9-0239-432f-8a94-77cc3d6f2ab0 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:47.265842 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-447c48f9-0239-432f-8a94-77cc3d6f2ab0 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:47.266780 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-447c48f9-0239-432f-8a94-77cc3d6f2ab0 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:47.267302 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-447c48f9-0239-432f-8a94-77cc3d6f2ab0 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:47.405622 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:47.428710 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=6 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:47.584652 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-447c48f9-0239-432f-8a94-77cc3d6f2ab0 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:47.592868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-447c48f9-0239-432f-8a94-77cc3d6f2ab0 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1318 microversion: 2.1 time: 0.339494 Jul 28 04:08:47.593462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 497/975] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:47 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:48.616168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c17e0553-5b34-4ef9-9dec-557a6a66d660 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:48.616764 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c17e0553-5b34-4ef9-9dec-557a6a66d660 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:48.619447 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:48.625221 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c17e0553-5b34-4ef9-9dec-557a6a66d660 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:48.625695 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c17e0553-5b34-4ef9-9dec-557a6a66d660 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:48.627135 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c17e0553-5b34-4ef9-9dec-557a6a66d660 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:48.627638 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c17e0553-5b34-4ef9-9dec-557a6a66d660 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:48.769601 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c17e0553-5b34-4ef9-9dec-557a6a66d660 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:48.778834 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c17e0553-5b34-4ef9-9dec-557a6a66d660 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1318 microversion: 2.1 time: 0.167172 Jul 28 04:08:48.779937 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 479/976] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:48 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:49.118168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-8387d46d-a914-40bf-89a8-04c8f63beefd req-5e1f1704-a7e9-4f12-a458-6b3f6bf40a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce2062d-983a-40bc-b219-6e28e56d39ed", "name": "network-vif-plugged", "status": "completed", "tag": "10ae9a7d-4659-46a5-a556-6df64f995b83"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:49.129682 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-8387d46d-a914-40bf-89a8-04c8f63beefd req-5e1f1704-a7e9-4f12-a458-6b3f6bf40a5b service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:49.130130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-8387d46d-a914-40bf-89a8-04c8f63beefd req-5e1f1704-a7e9-4f12-a458-6b3f6bf40a5b service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:49.143656 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-8387d46d-a914-40bf-89a8-04c8f63beefd req-5e1f1704-a7e9-4f12-a458-6b3f6bf40a5b service nova] Creating event network-vif-plugged:10ae9a7d-4659-46a5-a556-6df64f995b83 for instance 0ce2062d-983a-40bc-b219-6e28e56d39ed on hv-cinder-85127 Jul 28 04:08:49.149990 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-8387d46d-a914-40bf-89a8-04c8f63beefd req-5e1f1704-a7e9-4f12-a458-6b3f6bf40a5b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035487 Jul 28 04:08:49.150630 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 498/977] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:49.800191 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-449d1f84-00d0-4b7a-abb6-262b9c4587b8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:49.800921 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-449d1f84-00d0-4b7a-abb6-262b9c4587b8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:49.807924 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-449d1f84-00d0-4b7a-abb6-262b9c4587b8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:49.808414 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-449d1f84-00d0-4b7a-abb6-262b9c4587b8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:49.809237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-449d1f84-00d0-4b7a-abb6-262b9c4587b8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:49.809675 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-449d1f84-00d0-4b7a-abb6-262b9c4587b8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:49.962620 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-449d1f84-00d0-4b7a-abb6-262b9c4587b8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:49.973531 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-449d1f84-00d0-4b7a-abb6-262b9c4587b8 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1318 microversion: 2.1 time: 0.177956 Jul 28 04:08:49.974321 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 480/978] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:49 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:50.996613 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3628b437-c415-4c47-bd85-daa5e5f70dba tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:50.997322 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3628b437-c415-4c47-bd85-daa5e5f70dba tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:51.003839 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3628b437-c415-4c47-bd85-daa5e5f70dba tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:51.004346 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3628b437-c415-4c47-bd85-daa5e5f70dba tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:51.005135 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3628b437-c415-4c47-bd85-daa5e5f70dba tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:51.005583 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3628b437-c415-4c47-bd85-daa5e5f70dba tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:51.141968 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3628b437-c415-4c47-bd85-daa5e5f70dba tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:51.149940 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3628b437-c415-4c47-bd85-daa5e5f70dba tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1507 microversion: 2.1 time: 0.158858 Jul 28 04:08:51.150513 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 499/979] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:50 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:51.170616 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c7561d2c-9a8d-4740-b666-b29ec5f23636 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7020bb9-80a0-4104-9414-89f9b49b5786", "device": "/dev/sdb"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:51.174422 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c7561d2c-9a8d-4740-b666-b29ec5f23636 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:51.181518 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c7561d2c-9a8d-4740-b666-b29ec5f23636 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:51.181967 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c7561d2c-9a8d-4740-b666-b29ec5f23636 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:51.182737 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c7561d2c-9a8d-4740-b666-b29ec5f23636 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:51.183528 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c7561d2c-9a8d-4740-b666-b29ec5f23636 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:51.984218 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c7561d2c-9a8d-4740-b666-b29ec5f23636 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "POST /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817383 Jul 28 04:08:51.985224 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 481/980] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:08:51 2022] POST /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:55.971003 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:08:55.971598 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Thu Jul 28 04:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:09:02.310935 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0b6f2358-6890-45a0-a3c2-8c011ec91b37 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:02.311580 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0b6f2358-6890-45a0-a3c2-8c011ec91b37 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:02.314608 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:02.315274 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=40 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:02.320186 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0b6f2358-6890-45a0-a3c2-8c011ec91b37 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:02.320639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0b6f2358-6890-45a0-a3c2-8c011ec91b37 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:02.321405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0b6f2358-6890-45a0-a3c2-8c011ec91b37 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:02.321841 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0b6f2358-6890-45a0-a3c2-8c011ec91b37 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:02.348313 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0b6f2358-6890-45a0-a3c2-8c011ec91b37 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:09:02.714996 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0b6f2358-6890-45a0-a3c2-8c011ec91b37 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 204 len: 0 microversion: 2.1 time: 0.407653 Jul 28 04:09:02.715592 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 500/981] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:09:02 2022] DELETE /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:09:02.721839 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=18 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:02.722618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:02.726754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c4dbe1c8-12ac-46e0-8624-1f34ef9b249f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:02.727464 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c4dbe1c8-12ac-46e0-8624-1f34ef9b249f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:02.735607 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c4dbe1c8-12ac-46e0-8624-1f34ef9b249f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:02.736094 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c4dbe1c8-12ac-46e0-8624-1f34ef9b249f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:02.736887 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c4dbe1c8-12ac-46e0-8624-1f34ef9b249f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:02.737333 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c4dbe1c8-12ac-46e0-8624-1f34ef9b249f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:02.791835 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:09:02.792120 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Thu Jul 28 04:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 (ip 10.222.0.66) !!! Jul 28 04:09:02.881907 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c4dbe1c8-12ac-46e0-8624-1f34ef9b249f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:02.889907 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c4dbe1c8-12ac-46e0-8624-1f34ef9b249f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1575 microversion: 2.1 time: 0.169634 Jul 28 04:09:02.890483 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 482/982] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:02 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:03.912310 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8dccbb53-ae12-4486-81e8-1ba961abcfb7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:03.913096 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8dccbb53-ae12-4486-81e8-1ba961abcfb7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:03.920154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8dccbb53-ae12-4486-81e8-1ba961abcfb7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:03.920624 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8dccbb53-ae12-4486-81e8-1ba961abcfb7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:03.921424 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8dccbb53-ae12-4486-81e8-1ba961abcfb7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:03.922778 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8dccbb53-ae12-4486-81e8-1ba961abcfb7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:04.085720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8dccbb53-ae12-4486-81e8-1ba961abcfb7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:04.100833 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8dccbb53-ae12-4486-81e8-1ba961abcfb7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1575 microversion: 2.1 time: 0.192523 Jul 28 04:09:04.101901 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 501/983] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:03 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:05.124104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-376a2de0-3d56-4f04-b25b-8937200e4409 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:05.124715 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-376a2de0-3d56-4f04-b25b-8937200e4409 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:05.132769 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-376a2de0-3d56-4f04-b25b-8937200e4409 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:05.133734 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-376a2de0-3d56-4f04-b25b-8937200e4409 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:05.134024 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-376a2de0-3d56-4f04-b25b-8937200e4409 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:05.134469 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-376a2de0-3d56-4f04-b25b-8937200e4409 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:05.306799 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-376a2de0-3d56-4f04-b25b-8937200e4409 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:05.315043 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-376a2de0-3d56-4f04-b25b-8937200e4409 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1575 microversion: 2.1 time: 0.195799 Jul 28 04:09:05.315889 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 483/984] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:05 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:05.673893 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-d1896199-a9dc-4c79-bcbb-3160bb7bd489 req-431c23cd-783d-4745-86cf-82a253f6c9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b0538a6-ada9-4f1f-b47c-1aa7b6678a62", "name": "network-vif-deleted", "tag": "466b36f7-7bf9-400c-8d85-f37adcc930f6"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:05.685860 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-d1896199-a9dc-4c79-bcbb-3160bb7bd489 req-431c23cd-783d-4745-86cf-82a253f6c9d1 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:05.688187 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-d1896199-a9dc-4c79-bcbb-3160bb7bd489 req-431c23cd-783d-4745-86cf-82a253f6c9d1 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:05.699896 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-d1896199-a9dc-4c79-bcbb-3160bb7bd489 req-431c23cd-783d-4745-86cf-82a253f6c9d1 service nova] Creating event network-vif-deleted:466b36f7-7bf9-400c-8d85-f37adcc930f6 for instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 on hv-cinder-85127 Jul 28 04:09:05.706090 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-d1896199-a9dc-4c79-bcbb-3160bb7bd489 req-431c23cd-783d-4745-86cf-82a253f6c9d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041419 Jul 28 04:09:05.707392 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 502/985] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:06.338042 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-13787651-ae1e-443d-b23d-f5758524d8c3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:06.338765 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-13787651-ae1e-443d-b23d-f5758524d8c3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:06.346137 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-13787651-ae1e-443d-b23d-f5758524d8c3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:06.346697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-13787651-ae1e-443d-b23d-f5758524d8c3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:06.347555 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-13787651-ae1e-443d-b23d-f5758524d8c3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:06.348105 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-13787651-ae1e-443d-b23d-f5758524d8c3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:06.413961 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-13787651-ae1e-443d-b23d-f5758524d8c3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:06.424772 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-13787651-ae1e-443d-b23d-f5758524d8c3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1507 microversion: 2.1 time: 0.090611 Jul 28 04:09:06.425585 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 484/986] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:06 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1507 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:07.447874 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d84e43c7-2ca4-49a2-aeef-443e80cf9ea4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:07.448669 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d84e43c7-2ca4-49a2-aeef-443e80cf9ea4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:07.456209 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d84e43c7-2ca4-49a2-aeef-443e80cf9ea4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:07.456674 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d84e43c7-2ca4-49a2-aeef-443e80cf9ea4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:07.457473 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d84e43c7-2ca4-49a2-aeef-443e80cf9ea4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:07.457934 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d84e43c7-2ca4-49a2-aeef-443e80cf9ea4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:07.532921 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d84e43c7-2ca4-49a2-aeef-443e80cf9ea4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:07.541805 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d84e43c7-2ca4-49a2-aeef-443e80cf9ea4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1507 microversion: 2.1 time: 0.098236 Jul 28 04:09:07.555402 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 503/987] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:07 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1507 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:08.564368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:08.565101 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:08.571849 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:08.572340 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:08.573134 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:08.573581 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:08.608584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:08.609013 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:08.609469 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lazy-loading 'fault' on Instance uuid 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:09:08.653261 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:08.662072 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-942c3065-e585-435c-acd1-f83493ea007a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 200 len: 1229 microversion: 2.1 time: 0.101863 Jul 28 04:09:08.662760 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 485/988] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:08 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:09.686894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:09.687481 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:09.694057 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:09.694508 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:09.695277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:09.695716 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:09.711593 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] HTTP exception thrown: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Request method failure captured: Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 HTTP/1.1 Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gsm384Sc59-EMBvKFVbWJMVnjPyHZjPKRsUv920lVHIckgHNIj9CAQfbyPesoWWIBkpaOFgMvUC3rwshhd-rH2Gx2zwW2oAnU5U2zQP3xYgqtDcwTmGse7thAR2MojKZ1g3CYEmNWRnOhqrDxbne8Y_b_dQxF_naBkxwp4S437IjlM Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:09:09.713168 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9aa592e1b58f4804ad264f0cd721b1ca", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}] Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-TestVolumeBootPattern-414401148 Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 44734ee22727449fafcd470798c10abd Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:09:09.714827 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '7b0538a6-ada9-4f1f-b47c-1aa7b6678a62'} Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:09:09.716019 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:09:09.717626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:09.719044 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Returning 404 to user: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:09:09.719044 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-89ac5a78-e542-4f09-a231-3e9d2c91d658 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 404 len: 111 microversion: 2.1 time: 0.031687 Jul 28 04:09:09.719044 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 504/989] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:09 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:09:09.816290 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-678447869", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-743574221", "security_groups": [{"name": "tempest-secgroup-smoke-1803004242"}], "block_device_mapping_v2": [{"uuid": "290237aa-9696-495a-ae7e-d3aa94d8e167", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "672eb351-e67a-4327-be23-b1a7215130a6"}]}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:09.935641 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.network.neutron [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] validate_networks() for [('672eb351-e67a-4327-be23-b1a7215130a6', None, None, None, None, None)] {{(pid=135704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:09:10.335833 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Flavor limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:09:10.336291 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Image limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:09:10.336764 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Flavor pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:09:10.337172 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Image pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:09:10.337584 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:09:10.347038 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:10.347491 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:10.348350 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:10.348791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:10.365830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Getting quotas for project 9aa592e1b58f4804ad264f0cd721b1ca. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:09:10.369752 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Getting quotas for user 44734ee22727449fafcd470798c10abd and project 9aa592e1b58f4804ad264f0cd721b1ca. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:09:10.427223 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Going to run 1 instances... {{(pid=135704) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:09:10.429345 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='290237aa-9696-495a-ae7e-d3aa94d8e167',volume_size=None,volume_type=None)] {{(pid=135704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:09:10.814045 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c71d3d3b-1e77-42e4-953f-c5db3f7bce32 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.002030 Jul 28 04:09:10.814786 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 486/990] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:09:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:09:10.826473 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d3dfca10-e11d-4c77-991d-722361172145 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:10.827054 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d3dfca10-e11d-4c77-991d-722361172145 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:10.883346 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d3dfca10-e11d-4c77-991d-722361172145 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:10.890818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d3dfca10-e11d-4c77-991d-722361172145 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1093 microversion: 2.1 time: 0.068822 Jul 28 04:09:10.891483 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 505/991] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:10 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:11.912258 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-84042aa3-bdc4-42a1-87a9-2a0980286945 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:11.912876 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-84042aa3-bdc4-42a1-87a9-2a0980286945 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:11.920043 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-84042aa3-bdc4-42a1-87a9-2a0980286945 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:11.920452 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-84042aa3-bdc4-42a1-87a9-2a0980286945 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:11.928576 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-84042aa3-bdc4-42a1-87a9-2a0980286945 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:11.928576 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-84042aa3-bdc4-42a1-87a9-2a0980286945 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:11.999471 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-84042aa3-bdc4-42a1-87a9-2a0980286945 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:12.008639 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-84042aa3-bdc4-42a1-87a9-2a0980286945 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1143 microversion: 2.1 time: 0.101074 Jul 28 04:09:12.009680 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 487/992] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:11 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1143 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:12.208083 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-88c7b539-a9a8-4719-bdd6-e23805452402 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:12.208720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-88c7b539-a9a8-4719-bdd6-e23805452402 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:12.216089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-88c7b539-a9a8-4719-bdd6-e23805452402 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:12.216546 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-88c7b539-a9a8-4719-bdd6-e23805452402 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:12.217320 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-88c7b539-a9a8-4719-bdd6-e23805452402 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:12.217767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-88c7b539-a9a8-4719-bdd6-e23805452402 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:12.306396 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-88c7b539-a9a8-4719-bdd6-e23805452402 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lazy-loading 'services' on Instance uuid 0ce2062d-983a-40bc-b219-6e28e56d39ed {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:09:12.544996 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-88c7b539-a9a8-4719-bdd6-e23805452402 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed/os-volume_attachments/a7020bb9-80a0-4104-9414-89f9b49b5786" status: 202 len: 0 microversion: 2.1 time: 0.340612 Jul 28 04:09:12.545845 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 506/993] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:09:12 2022] DELETE /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed/os-volume_attachments/a7020bb9-80a0-4104-9414-89f9b49b5786 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:09:13.030862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6f9ba3be-f371-4bc7-b950-c700f80ea01c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:13.031469 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6f9ba3be-f371-4bc7-b950-c700f80ea01c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:13.038402 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6f9ba3be-f371-4bc7-b950-c700f80ea01c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:13.038858 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6f9ba3be-f371-4bc7-b950-c700f80ea01c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:13.039703 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6f9ba3be-f371-4bc7-b950-c700f80ea01c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:13.040189 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6f9ba3be-f371-4bc7-b950-c700f80ea01c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:13.123566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-6f9ba3be-f371-4bc7-b950-c700f80ea01c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:13.133183 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6f9ba3be-f371-4bc7-b950-c700f80ea01c tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1199 microversion: 2.1 time: 0.106169 Jul 28 04:09:13.144230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 488/994] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:13 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:13.680012 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0920878f-dd14-40ce-8a38-7cf90990f2aa tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:13.680611 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0920878f-dd14-40ce-8a38-7cf90990f2aa tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:13.687138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0920878f-dd14-40ce-8a38-7cf90990f2aa tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:13.687596 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0920878f-dd14-40ce-8a38-7cf90990f2aa tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:13.689109 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0920878f-dd14-40ce-8a38-7cf90990f2aa tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:13.689564 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0920878f-dd14-40ce-8a38-7cf90990f2aa tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:13.719741 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0920878f-dd14-40ce-8a38-7cf90990f2aa tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:09:14.122729 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0920878f-dd14-40ce-8a38-7cf90990f2aa tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 204 len: 0 microversion: 2.1 time: 0.447732 Jul 28 04:09:14.124148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 507/995] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:09:13 2022] DELETE /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:09:14.133588 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-617c350b-1b51-42bf-9a98-b951a6af1561 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:14.134192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-617c350b-1b51-42bf-9a98-b951a6af1561 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:14.141201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-617c350b-1b51-42bf-9a98-b951a6af1561 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:14.142368 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-617c350b-1b51-42bf-9a98-b951a6af1561 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:14.143234 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-617c350b-1b51-42bf-9a98-b951a6af1561 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:14.143636 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-617c350b-1b51-42bf-9a98-b951a6af1561 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:14.159768 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8d394937-4992-4586-be53-c404eb9e949b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:14.160898 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8d394937-4992-4586-be53-c404eb9e949b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:14.172369 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8d394937-4992-4586-be53-c404eb9e949b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:14.172886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8d394937-4992-4586-be53-c404eb9e949b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:14.173825 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8d394937-4992-4586-be53-c404eb9e949b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:14.174258 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8d394937-4992-4586-be53-c404eb9e949b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:14.304504 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-617c350b-1b51-42bf-9a98-b951a6af1561 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:14.304504 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-617c350b-1b51-42bf-9a98-b951a6af1561 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1513 microversion: 2.1 time: 0.174153 Jul 28 04:09:14.304504 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 489/996] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:14 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:14.339506 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8d394937-4992-4586-be53-c404eb9e949b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:14.348080 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8d394937-4992-4586-be53-c404eb9e949b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1277 microversion: 2.1 time: 0.194095 Jul 28 04:09:14.348789 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 508/997] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:14 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:15.326070 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2b7f4924-00cd-413c-9266-3e77a8424d2f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:15.326687 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2b7f4924-00cd-413c-9266-3e77a8424d2f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:15.333311 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2b7f4924-00cd-413c-9266-3e77a8424d2f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:15.333774 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2b7f4924-00cd-413c-9266-3e77a8424d2f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:15.334548 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2b7f4924-00cd-413c-9266-3e77a8424d2f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:15.334995 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2b7f4924-00cd-413c-9266-3e77a8424d2f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:15.369657 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b3b405ca-3183-42ac-8192-4221e3312e31 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:15.370646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b3b405ca-3183-42ac-8192-4221e3312e31 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:15.377806 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b3b405ca-3183-42ac-8192-4221e3312e31 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:15.378273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b3b405ca-3183-42ac-8192-4221e3312e31 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:15.379138 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b3b405ca-3183-42ac-8192-4221e3312e31 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:15.379534 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b3b405ca-3183-42ac-8192-4221e3312e31 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:15.527879 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b3b405ca-3183-42ac-8192-4221e3312e31 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:15.536105 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b3b405ca-3183-42ac-8192-4221e3312e31 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1277 microversion: 2.1 time: 0.170181 Jul 28 04:09:15.536728 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 509/998] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:15 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:15.545972 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2b7f4924-00cd-413c-9266-3e77a8424d2f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:15.554910 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2b7f4924-00cd-413c-9266-3e77a8424d2f tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1513 microversion: 2.1 time: 0.232694 Jul 28 04:09:15.555493 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 490/999] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:15 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:16.482474 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-52e63d30-d20a-4859-9448-99d144e3a47c req-9aa6b1af-c12c-4972-aac2-927fdd39177a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa34a319-36da-4d32-879f-76740e89aecc", "tag": "bf07003f-197f-47fc-987f-30b50dad1a5e"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:16.495444 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-52e63d30-d20a-4859-9448-99d144e3a47c req-9aa6b1af-c12c-4972-aac2-927fdd39177a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:16.495673 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-52e63d30-d20a-4859-9448-99d144e3a47c req-9aa6b1af-c12c-4972-aac2-927fdd39177a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:16.514512 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-52e63d30-d20a-4859-9448-99d144e3a47c req-9aa6b1af-c12c-4972-aac2-927fdd39177a service nova] Creating event network-changed:bf07003f-197f-47fc-987f-30b50dad1a5e for instance fa34a319-36da-4d32-879f-76740e89aecc on hv-cinder-85127 Jul 28 04:09:16.523306 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-52e63d30-d20a-4859-9448-99d144e3a47c req-9aa6b1af-c12c-4972-aac2-927fdd39177a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050128 Jul 28 04:09:16.523927 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 510/1000] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:16.559128 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ce7e797b-85b7-4f3c-b339-6b89f41e0ad5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:16.562661 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ce7e797b-85b7-4f3c-b339-6b89f41e0ad5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:16.577228 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-efc35635-fd13-4422-bf31-ca08dafe9aca tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:16.579467 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-efc35635-fd13-4422-bf31-ca08dafe9aca tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:16.583693 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ce7e797b-85b7-4f3c-b339-6b89f41e0ad5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:16.584441 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ce7e797b-85b7-4f3c-b339-6b89f41e0ad5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:16.585480 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ce7e797b-85b7-4f3c-b339-6b89f41e0ad5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:16.586466 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ce7e797b-85b7-4f3c-b339-6b89f41e0ad5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:16.588112 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-efc35635-fd13-4422-bf31-ca08dafe9aca tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:16.588684 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-efc35635-fd13-4422-bf31-ca08dafe9aca tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:16.589586 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-efc35635-fd13-4422-bf31-ca08dafe9aca tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:16.590166 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-efc35635-fd13-4422-bf31-ca08dafe9aca tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:16.666597 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-efc35635-fd13-4422-bf31-ca08dafe9aca tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f18c8b60541a18d61a467a74d592a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b3cf737ddd463f8f77ebe29d23fc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:16.690008 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-efc35635-fd13-4422-bf31-ca08dafe9aca tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 200 len: 1471 microversion: 2.1 time: 0.117153 Jul 28 04:09:16.691477 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 511/1001] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:16 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 1471 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:16.853592 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ce7e797b-85b7-4f3c-b339-6b89f41e0ad5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:16.867838 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ce7e797b-85b7-4f3c-b339-6b89f41e0ad5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.312464 Jul 28 04:09:16.868910 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 491/1002] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:16 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:17.722420 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:17.723045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] [instance: 0ce2062d-983a-40bc-b219-6e28e56d39ed] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:17.729947 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:17.731316 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:17.731316 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:17.731522 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:17.748603 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] HTTP exception thrown: Instance 0ce2062d-983a-40bc-b219-6e28e56d39ed could not be found. Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Request method failure captured: Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed HTTP/1.1 Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gtxAuNck7InJehaLf0K8udGUt1CA2QH7l73WQyHWzhcnKzqkBOuYrscaNi7Ux_XDhtSibQ5vc2fBaKUQgKKwCRrgZDLlxoXpY3E2JfnQwyYnvtoJFTE-5osZLKBOUqwLlgQLrMIcJ6-g_zFXXA-z6nT-YLQTQy_zQs38gdweHW-Idg Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 83b3cf737ddd463f8f77ebe29d23fc7e Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-VolumesSnapshotTestJSON-362652760 Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:09:17.750277 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_83b3cf737ddd463f8f77ebe29d23fc7e", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/83b3cf737ddd463f8f77ebe29d23fc7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/83b3cf737ddd463f8f77ebe29d23fc7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/83b3cf737ddd463f8f77ebe29d23fc7e"}]}] Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-VolumesSnapshotTestJSON-362652760 Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 83b3cf737ddd463f8f77ebe29d23fc7e Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-362652760 Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-VolumesSnapshotTestJSON-362652760-project Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 329f18c8b60541a18d61a467a74d592a Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-VolumesSnapshotTestJSON-362652760-project Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 0ce2062d-983a-40bc-b219-6e28e56d39ed could not be found. Jul 28 04:09:17.752391 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '0ce2062d-983a-40bc-b219-6e28e56d39ed'} Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce2062d-983a-40bc-b219-6e28e56d39ed could not be found. Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:09:17.753333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce2062d-983a-40bc-b219-6e28e56d39ed could not be found. Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce2062d-983a-40bc-b219-6e28e56d39ed could not be found. Jul 28 04:09:17.754837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:09:17.756259 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] Returning 404 to user: Instance 0ce2062d-983a-40bc-b219-6e28e56d39ed could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:09:17.756259 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e021f157-8e32-4883-8246-8f59b71777b2 tempest-VolumesSnapshotTestJSON-362652760 tempest-VolumesSnapshotTestJSON-362652760-project] 10.222.0.66 "GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed" status: 404 len: 111 microversion: 2.1 time: 0.033513 Jul 28 04:09:17.756259 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 512/1003] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:17 2022] GET /compute/v2.1/servers/0ce2062d-983a-40bc-b219-6e28e56d39ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:09:17.889951 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8dde0d80-618a-44d5-b3bf-5d24dfa4598a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:17.890793 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8dde0d80-618a-44d5-b3bf-5d24dfa4598a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:17.898378 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8dde0d80-618a-44d5-b3bf-5d24dfa4598a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:17.898836 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8dde0d80-618a-44d5-b3bf-5d24dfa4598a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:17.899634 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8dde0d80-618a-44d5-b3bf-5d24dfa4598a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:17.900126 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8dde0d80-618a-44d5-b3bf-5d24dfa4598a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:18.038827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8dde0d80-618a-44d5-b3bf-5d24dfa4598a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:18.046487 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8dde0d80-618a-44d5-b3bf-5d24dfa4598a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.160374 Jul 28 04:09:18.047053 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 492/1004] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:17 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:18.544559 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-f67ce6b3-fa4b-4e50-90c1-edffd8b66b30 req-f052413b-081d-4d26-ada1-7fdaa95c18bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce2062d-983a-40bc-b219-6e28e56d39ed", "name": "network-vif-deleted", "tag": "10ae9a7d-4659-46a5-a556-6df64f995b83"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:18.555119 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-f67ce6b3-fa4b-4e50-90c1-edffd8b66b30 req-f052413b-081d-4d26-ada1-7fdaa95c18bb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:18.555566 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-f67ce6b3-fa4b-4e50-90c1-edffd8b66b30 req-f052413b-081d-4d26-ada1-7fdaa95c18bb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:18.568426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-f67ce6b3-fa4b-4e50-90c1-edffd8b66b30 req-f052413b-081d-4d26-ada1-7fdaa95c18bb service nova] Creating event network-vif-deleted:10ae9a7d-4659-46a5-a556-6df64f995b83 for instance 0ce2062d-983a-40bc-b219-6e28e56d39ed on hv-cinder-85127 Jul 28 04:09:18.573491 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-f67ce6b3-fa4b-4e50-90c1-edffd8b66b30 req-f052413b-081d-4d26-ada1-7fdaa95c18bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032818 Jul 28 04:09:18.574114 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 513/1005] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:19.069172 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-baa303b8-649b-4e92-9028-c57b182e4b43 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:19.070214 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-baa303b8-649b-4e92-9028-c57b182e4b43 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:19.076486 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-baa303b8-649b-4e92-9028-c57b182e4b43 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:19.076940 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-baa303b8-649b-4e92-9028-c57b182e4b43 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:19.077735 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-baa303b8-649b-4e92-9028-c57b182e4b43 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:19.078194 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-baa303b8-649b-4e92-9028-c57b182e4b43 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:19.240701 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-baa303b8-649b-4e92-9028-c57b182e4b43 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:19.249763 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-baa303b8-649b-4e92-9028-c57b182e4b43 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.186085 Jul 28 04:09:19.250345 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 493/1006] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:19 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:20.271590 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d5f1fd71-5d9a-4544-b6d5-ada694369d6d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:20.272324 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d5f1fd71-5d9a-4544-b6d5-ada694369d6d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:20.279043 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d5f1fd71-5d9a-4544-b6d5-ada694369d6d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:20.279497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d5f1fd71-5d9a-4544-b6d5-ada694369d6d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:20.280311 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d5f1fd71-5d9a-4544-b6d5-ada694369d6d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:20.280759 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-d5f1fd71-5d9a-4544-b6d5-ada694369d6d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:20.421580 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d5f1fd71-5d9a-4544-b6d5-ada694369d6d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:20.429276 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d5f1fd71-5d9a-4544-b6d5-ada694369d6d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.162694 Jul 28 04:09:20.429851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 514/1007] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:20 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:21.450298 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ef88586f-45c2-4d0d-9d9c-3074b465a1c1 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:21.451207 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ef88586f-45c2-4d0d-9d9c-3074b465a1c1 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:21.453459 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:21.454135 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=6 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:21.460916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef88586f-45c2-4d0d-9d9c-3074b465a1c1 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:21.461644 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef88586f-45c2-4d0d-9d9c-3074b465a1c1 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:21.467057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef88586f-45c2-4d0d-9d9c-3074b465a1c1 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:21.467057 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef88586f-45c2-4d0d-9d9c-3074b465a1c1 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:21.608689 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ef88586f-45c2-4d0d-9d9c-3074b465a1c1 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:21.616318 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ef88586f-45c2-4d0d-9d9c-3074b465a1c1 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.169814 Jul 28 04:09:21.616900 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 494/1008] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:21 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:22.637844 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-284a45b8-4c04-423a-a742-1beb08ba8020 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:22.638464 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-284a45b8-4c04-423a-a742-1beb08ba8020 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:22.640562 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:22.646837 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-284a45b8-4c04-423a-a742-1beb08ba8020 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:22.647301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-284a45b8-4c04-423a-a742-1beb08ba8020 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:22.648133 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-284a45b8-4c04-423a-a742-1beb08ba8020 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:22.648588 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-284a45b8-4c04-423a-a742-1beb08ba8020 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:22.788488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-284a45b8-4c04-423a-a742-1beb08ba8020 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:22.796146 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-284a45b8-4c04-423a-a742-1beb08ba8020 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.162120 Jul 28 04:09:22.796715 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 515/1009] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:22 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:23.817346 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-462277d8-41a1-494b-8cc3-3cba36112c52 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:23.818183 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-462277d8-41a1-494b-8cc3-3cba36112c52 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:23.824651 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-462277d8-41a1-494b-8cc3-3cba36112c52 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:23.825113 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-462277d8-41a1-494b-8cc3-3cba36112c52 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:23.825905 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-462277d8-41a1-494b-8cc3-3cba36112c52 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:23.826383 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-462277d8-41a1-494b-8cc3-3cba36112c52 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:23.971270 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-462277d8-41a1-494b-8cc3-3cba36112c52 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:23.978993 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-462277d8-41a1-494b-8cc3-3cba36112c52 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.166229 Jul 28 04:09:23.979566 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 495/1010] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:23 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:25.000724 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6149c725-9eca-4a80-994b-9bc932bf0601 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:25.001302 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6149c725-9eca-4a80-994b-9bc932bf0601 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:25.008181 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6149c725-9eca-4a80-994b-9bc932bf0601 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:25.008638 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6149c725-9eca-4a80-994b-9bc932bf0601 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:25.009740 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6149c725-9eca-4a80-994b-9bc932bf0601 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:25.010437 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6149c725-9eca-4a80-994b-9bc932bf0601 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:25.146625 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6149c725-9eca-4a80-994b-9bc932bf0601 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:25.150108 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:25.154535 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6149c725-9eca-4a80-994b-9bc932bf0601 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.157829 Jul 28 04:09:25.155104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 516/1011] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:24 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:26.178456 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-fc14cd82-df51-4d8c-b0fc-03186603456a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:26.179253 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-fc14cd82-df51-4d8c-b0fc-03186603456a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:26.187583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fc14cd82-df51-4d8c-b0fc-03186603456a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.191394 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fc14cd82-df51-4d8c-b0fc-03186603456a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.192393 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fc14cd82-df51-4d8c-b0fc-03186603456a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.192925 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-fc14cd82-df51-4d8c-b0fc-03186603456a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.339827 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-fc14cd82-df51-4d8c-b0fc-03186603456a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:26.348183 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-fc14cd82-df51-4d8c-b0fc-03186603456a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.175333 Jul 28 04:09:26.348762 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 496/1012] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:26 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:27.369013 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1c2bffef-6818-479e-a344-406042639cca tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:27.369562 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1c2bffef-6818-479e-a344-406042639cca tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:27.378023 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c2bffef-6818-479e-a344-406042639cca tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.378488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c2bffef-6818-479e-a344-406042639cca tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.379286 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c2bffef-6818-479e-a344-406042639cca tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.379740 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1c2bffef-6818-479e-a344-406042639cca tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.529732 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1c2bffef-6818-479e-a344-406042639cca tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:27.538841 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1c2bffef-6818-479e-a344-406042639cca tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.173801 Jul 28 04:09:27.539433 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 517/1013] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:27 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:27.827362 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-a828cdb4-09e4-405e-9d18-c84bca67c906 req-e9ec75c9-9eb6-46cf-9857-5d78b7e0895d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa34a319-36da-4d32-879f-76740e89aecc", "name": "network-vif-plugged", "status": "completed", "tag": "bf07003f-197f-47fc-987f-30b50dad1a5e"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:27.838890 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-a828cdb4-09e4-405e-9d18-c84bca67c906 req-e9ec75c9-9eb6-46cf-9857-5d78b7e0895d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.839482 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-a828cdb4-09e4-405e-9d18-c84bca67c906 req-e9ec75c9-9eb6-46cf-9857-5d78b7e0895d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.852928 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-a828cdb4-09e4-405e-9d18-c84bca67c906 req-e9ec75c9-9eb6-46cf-9857-5d78b7e0895d service nova] Creating event network-vif-plugged:bf07003f-197f-47fc-987f-30b50dad1a5e for instance fa34a319-36da-4d32-879f-76740e89aecc on hv-cinder-85127 Jul 28 04:09:27.858114 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-a828cdb4-09e4-405e-9d18-c84bca67c906 req-e9ec75c9-9eb6-46cf-9857-5d78b7e0895d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034549 Jul 28 04:09:27.858714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 497/1014] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:28.561363 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7ea7d990-4d50-4172-9075-0f473e98e4ae tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:28.561932 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7ea7d990-4d50-4172-9075-0f473e98e4ae tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:28.568963 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7ea7d990-4d50-4172-9075-0f473e98e4ae tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:28.569418 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7ea7d990-4d50-4172-9075-0f473e98e4ae tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:28.570205 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7ea7d990-4d50-4172-9075-0f473e98e4ae tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:28.570651 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7ea7d990-4d50-4172-9075-0f473e98e4ae tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:28.726849 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7ea7d990-4d50-4172-9075-0f473e98e4ae tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:28.735498 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7ea7d990-4d50-4172-9075-0f473e98e4ae tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.178498 Jul 28 04:09:28.736868 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 518/1015] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:28 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:29.758694 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-9f4135c8-533b-4783-868f-c551d413a89a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:29.759515 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-9f4135c8-533b-4783-868f-c551d413a89a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:29.767573 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9f4135c8-533b-4783-868f-c551d413a89a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:29.768068 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9f4135c8-533b-4783-868f-c551d413a89a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:29.768866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9f4135c8-533b-4783-868f-c551d413a89a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:29.769305 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-9f4135c8-533b-4783-868f-c551d413a89a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:29.914187 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-9f4135c8-533b-4783-868f-c551d413a89a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:29.921973 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-9f4135c8-533b-4783-868f-c551d413a89a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.167577 Jul 28 04:09:29.922565 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 498/1016] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:29 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:30.943756 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5a7172bd-5686-4244-9a05-b2de0087a647 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:30.944493 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5a7172bd-5686-4244-9a05-b2de0087a647 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:30.951376 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a7172bd-5686-4244-9a05-b2de0087a647 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:30.951838 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a7172bd-5686-4244-9a05-b2de0087a647 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:30.952662 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a7172bd-5686-4244-9a05-b2de0087a647 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:30.953112 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a7172bd-5686-4244-9a05-b2de0087a647 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:31.113015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5a7172bd-5686-4244-9a05-b2de0087a647 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:31.121161 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5a7172bd-5686-4244-9a05-b2de0087a647 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.182107 Jul 28 04:09:31.121745 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 519/1017] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:30 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:32.144142 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0fcf2715-f130-4c2d-bbcf-ebac3d16fe0f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:32.144868 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0fcf2715-f130-4c2d-bbcf-ebac3d16fe0f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:32.151833 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fcf2715-f130-4c2d-bbcf-ebac3d16fe0f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:32.152354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fcf2715-f130-4c2d-bbcf-ebac3d16fe0f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:32.153175 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fcf2715-f130-4c2d-bbcf-ebac3d16fe0f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:32.153618 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fcf2715-f130-4c2d-bbcf-ebac3d16fe0f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:32.177776 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=100 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:32.349899 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0fcf2715-f130-4c2d-bbcf-ebac3d16fe0f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:32.355260 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0fcf2715-f130-4c2d-bbcf-ebac3d16fe0f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1265 microversion: 2.1 time: 0.216414 Jul 28 04:09:32.356870 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 499/1018] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:32 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:33.379878 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-753031b8-6904-4c2d-adbe-92a9489c6533 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:33.380559 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-753031b8-6904-4c2d-adbe-92a9489c6533 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:33.383087 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:33.388875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-753031b8-6904-4c2d-adbe-92a9489c6533 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:33.389331 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-753031b8-6904-4c2d-adbe-92a9489c6533 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:33.390190 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-753031b8-6904-4c2d-adbe-92a9489c6533 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:33.390740 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-753031b8-6904-4c2d-adbe-92a9489c6533 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:33.548703 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-753031b8-6904-4c2d-adbe-92a9489c6533 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:33.557902 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-753031b8-6904-4c2d-adbe-92a9489c6533 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1450 microversion: 2.1 time: 0.182880 Jul 28 04:09:33.558488 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 520/1019] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:33 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:33.578288 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d7e1dc30-6dd6-4c7b-93ca-abb2db5b3f20 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:33.578906 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d7e1dc30-6dd6-4c7b-93ca-abb2db5b3f20 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:33.581448 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:33.586373 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7e1dc30-6dd6-4c7b-93ca-abb2db5b3f20 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:33.586836 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7e1dc30-6dd6-4c7b-93ca-abb2db5b3f20 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:33.587628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7e1dc30-6dd6-4c7b-93ca-abb2db5b3f20 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:33.588107 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d7e1dc30-6dd6-4c7b-93ca-abb2db5b3f20 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:33.727814 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-d7e1dc30-6dd6-4c7b-93ca-abb2db5b3f20 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:33.735589 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d7e1dc30-6dd6-4c7b-93ca-abb2db5b3f20 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1450 microversion: 2.1 time: 0.161162 Jul 28 04:09:33.736900 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 500/1020] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:33 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:36.332182 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-957463ce-9b87-4cf9-9b37-cc2af5fbb3e8 req-5382c001-6b00-4c90-9d64-63c87393d5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa34a319-36da-4d32-879f-76740e89aecc", "tag": "bf07003f-197f-47fc-987f-30b50dad1a5e"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:36.342973 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-957463ce-9b87-4cf9-9b37-cc2af5fbb3e8 req-5382c001-6b00-4c90-9d64-63c87393d5cd service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:36.348536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-957463ce-9b87-4cf9-9b37-cc2af5fbb3e8 req-5382c001-6b00-4c90-9d64-63c87393d5cd service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:36.355976 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-957463ce-9b87-4cf9-9b37-cc2af5fbb3e8 req-5382c001-6b00-4c90-9d64-63c87393d5cd service nova] Creating event network-changed:bf07003f-197f-47fc-987f-30b50dad1a5e for instance fa34a319-36da-4d32-879f-76740e89aecc on hv-cinder-85127 Jul 28 04:09:36.362041 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-957463ce-9b87-4cf9-9b37-cc2af5fbb3e8 req-5382c001-6b00-4c90-9d64-63c87393d5cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034523 Jul 28 04:09:36.362653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 521/1021] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:11.764723 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-80c957c9-80df-40b3-8a6e-53306f4ec5c8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Action: 'create', calling method: .version_select at 0x7f5572e5d3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-999863052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIewsTuy+PUhSt5+tdOW4swzw4DeDgPqX7cQOilAYa/g4PIkQg2BRNxIP4S+oH6sX9VhWGfPcsW3aLIwJSJpcuI6LxrkgOy0Crmp8TRhg4d0f17ukyOUlb1rHACut5SSlQ=="}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:11.771613 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=8 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:11.783211 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-80c957c9-80df-40b3-8a6e-53306f4ec5c8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Getting quotas for project a4c201d8672b4b2dab2a3fe4ef1242ec. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:10:11.787400 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-80c957c9-80df-40b3-8a6e-53306f4ec5c8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Getting quotas for user 54f8eea1619047d08651b6cbe0b11862 and project a4c201d8672b4b2dab2a3fe4ef1242ec. Resources: {'key_pairs'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:10:11.931839 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-80c957c9-80df-40b3-8a6e-53306f4ec5c8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.170885 Jul 28 04:10:11.932399 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 501/1022] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Jul 28 04:10:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:11.982595 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:11.983454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=26 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:11.987900 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1390287196", "imageRef": "0e2a7752-9216-490f-8788-69075cb70f80", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-999863052", "networks": [{"uuid": "94a232cd-980c-4117-bf05-f93f541f3ce6"}]}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:12.046212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.network.neutron [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] validate_networks() for [('94a232cd-980c-4117-bf05-f93f541f3ce6', None, None, None, None, None)] {{(pid=135703) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:10:12.530052 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Flavor limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:10:12.530476 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Image limits 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:10:12.530952 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Flavor pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:10:12.531361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Image pref 0:0:0 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:10:12.531767 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.virt.hardware [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:10:12.541952 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:12.542411 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:12.543231 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:12.544199 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:12.561331 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Getting quotas for project a4c201d8672b4b2dab2a3fe4ef1242ec. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:10:12.565466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.quota [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Getting quotas for user 54f8eea1619047d08651b6cbe0b11862 and project a4c201d8672b4b2dab2a3fe4ef1242ec. Resources: {'cores', 'instances', 'ram'} {{(pid=135703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:10:12.576754 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Going to run 1 instances... {{(pid=135703) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:10:12.579049 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0e2a7752-9216-490f-8788-69075cb70f80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=135703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:10:12.749739 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a62e33ed-c239-4304-9023-8b4f62eb932d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768918 Jul 28 04:10:12.750385 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 522/1023] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:10:12.761769 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-f665b4ab-5c68-4d1b-907a-8f894ff6c729 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:12.762400 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-f665b4ab-5c68-4d1b-907a-8f894ff6c729 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:12.828392 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-f665b4ab-5c68-4d1b-907a-8f894ff6c729 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:12.835639 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-f665b4ab-5c68-4d1b-907a-8f894ff6c729 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1258 microversion: 2.1 time: 0.078216 Jul 28 04:10:12.836251 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 502/1024] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:12 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:13.857876 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b4f9a1d8-6b90-46e2-a5db-98b3f1535001 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:13.858766 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b4f9a1d8-6b90-46e2-a5db-98b3f1535001 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:13.916963 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b4f9a1d8-6b90-46e2-a5db-98b3f1535001 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:13.925475 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b4f9a1d8-6b90-46e2-a5db-98b3f1535001 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1258 microversion: 2.1 time: 0.071521 Jul 28 04:10:13.926056 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 523/1025] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:13 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:14.946820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-55f93868-86f1-47cf-b5c8-ef309abaaeb0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:14.947674 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-55f93868-86f1-47cf-b5c8-ef309abaaeb0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:14.954939 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-55f93868-86f1-47cf-b5c8-ef309abaaeb0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:14.955394 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-55f93868-86f1-47cf-b5c8-ef309abaaeb0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:14.956836 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-55f93868-86f1-47cf-b5c8-ef309abaaeb0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:14.957470 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-55f93868-86f1-47cf-b5c8-ef309abaaeb0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:15.028583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-55f93868-86f1-47cf-b5c8-ef309abaaeb0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:15.036570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-55f93868-86f1-47cf-b5c8-ef309abaaeb0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1254 microversion: 2.1 time: 0.093614 Jul 28 04:10:15.038296 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 503/1026] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:14 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1254 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:16.061697 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-27e0b37d-ff05-4b68-b427-a15ad60ad828 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:16.064785 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-27e0b37d-ff05-4b68-b427-a15ad60ad828 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:16.074426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-27e0b37d-ff05-4b68-b427-a15ad60ad828 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:16.074895 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-27e0b37d-ff05-4b68-b427-a15ad60ad828 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:16.075844 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-27e0b37d-ff05-4b68-b427-a15ad60ad828 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:16.076373 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-27e0b37d-ff05-4b68-b427-a15ad60ad828 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:16.148836 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-27e0b37d-ff05-4b68-b427-a15ad60ad828 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:16.160302 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-27e0b37d-ff05-4b68-b427-a15ad60ad828 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1316 microversion: 2.1 time: 0.101732 Jul 28 04:10:16.168219 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 524/1027] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:16 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1316 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:17.182490 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-86aec6af-1f65-45aa-97c8-b393665e46d7 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:17.183716 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-86aec6af-1f65-45aa-97c8-b393665e46d7 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:17.191405 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-86aec6af-1f65-45aa-97c8-b393665e46d7 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.191853 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-86aec6af-1f65-45aa-97c8-b393665e46d7 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:17.192669 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-86aec6af-1f65-45aa-97c8-b393665e46d7 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.193131 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-86aec6af-1f65-45aa-97c8-b393665e46d7 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:17.347920 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-86aec6af-1f65-45aa-97c8-b393665e46d7 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:17.357556 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-86aec6af-1f65-45aa-97c8-b393665e46d7 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.178975 Jul 28 04:10:17.358142 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 504/1028] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:17 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:18.384095 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a71a7a00-9463-4122-9c24-786476c6f4e3 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:18.385761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a71a7a00-9463-4122-9c24-786476c6f4e3 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:18.395682 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a71a7a00-9463-4122-9c24-786476c6f4e3 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:18.396323 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a71a7a00-9463-4122-9c24-786476c6f4e3 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:18.397248 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a71a7a00-9463-4122-9c24-786476c6f4e3 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:18.397776 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a71a7a00-9463-4122-9c24-786476c6f4e3 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:18.540998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-a71a7a00-9463-4122-9c24-786476c6f4e3 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:18.548653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a71a7a00-9463-4122-9c24-786476c6f4e3 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.168720 Jul 28 04:10:18.549426 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 525/1029] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:18 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:19.571097 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-14b6528d-2300-4d02-8721-b8a7321930dc tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:19.571703 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-14b6528d-2300-4d02-8721-b8a7321930dc tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:19.578589 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-14b6528d-2300-4d02-8721-b8a7321930dc tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:19.578903 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-14b6528d-2300-4d02-8721-b8a7321930dc tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:19.579716 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-14b6528d-2300-4d02-8721-b8a7321930dc tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:19.580159 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-14b6528d-2300-4d02-8721-b8a7321930dc tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:19.736553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-14b6528d-2300-4d02-8721-b8a7321930dc tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:19.744820 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-14b6528d-2300-4d02-8721-b8a7321930dc tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.177651 Jul 28 04:10:19.749858 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 505/1030] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:19 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:20.767353 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-459cfb28-1034-4493-8de1-2867a5cfe04e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:20.768154 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-459cfb28-1034-4493-8de1-2867a5cfe04e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:20.775859 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-459cfb28-1034-4493-8de1-2867a5cfe04e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:20.776456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-459cfb28-1034-4493-8de1-2867a5cfe04e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:20.777273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-459cfb28-1034-4493-8de1-2867a5cfe04e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:20.777895 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-459cfb28-1034-4493-8de1-2867a5cfe04e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:20.934227 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-459cfb28-1034-4493-8de1-2867a5cfe04e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:20.942307 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-459cfb28-1034-4493-8de1-2867a5cfe04e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.179196 Jul 28 04:10:20.943101 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 526/1031] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:20 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:21.962966 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-bd1b2e10-79b5-450b-8f84-dd1716d33005 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:21.963619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-bd1b2e10-79b5-450b-8f84-dd1716d33005 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:21.970242 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bd1b2e10-79b5-450b-8f84-dd1716d33005 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:21.970708 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bd1b2e10-79b5-450b-8f84-dd1716d33005 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:21.972162 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bd1b2e10-79b5-450b-8f84-dd1716d33005 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:21.972611 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-bd1b2e10-79b5-450b-8f84-dd1716d33005 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:22.116528 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-bd1b2e10-79b5-450b-8f84-dd1716d33005 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:22.124470 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-bd1b2e10-79b5-450b-8f84-dd1716d33005 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.165207 Jul 28 04:10:22.125264 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 506/1032] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:21 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:23.147826 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-53649f25-84a0-4b2a-ad5e-7c15cb84d847 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:23.148521 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-53649f25-84a0-4b2a-ad5e-7c15cb84d847 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:23.155125 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:23.156795 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-53649f25-84a0-4b2a-ad5e-7c15cb84d847 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:23.157280 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-53649f25-84a0-4b2a-ad5e-7c15cb84d847 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:23.158056 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-53649f25-84a0-4b2a-ad5e-7c15cb84d847 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:23.158522 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-53649f25-84a0-4b2a-ad5e-7c15cb84d847 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:23.304761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-53649f25-84a0-4b2a-ad5e-7c15cb84d847 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:23.313285 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-53649f25-84a0-4b2a-ad5e-7c15cb84d847 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.171100 Jul 28 04:10:23.313881 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 527/1033] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:23 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:24.334697 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1b1a60f4-92a3-4660-9d15-39bf9883f763 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:24.335313 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1b1a60f4-92a3-4660-9d15-39bf9883f763 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:24.337192 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=6 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:24.342725 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1b1a60f4-92a3-4660-9d15-39bf9883f763 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:24.344646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1b1a60f4-92a3-4660-9d15-39bf9883f763 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:24.344646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1b1a60f4-92a3-4660-9d15-39bf9883f763 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:24.344646 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1b1a60f4-92a3-4660-9d15-39bf9883f763 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:24.527100 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1b1a60f4-92a3-4660-9d15-39bf9883f763 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:24.536600 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1b1a60f4-92a3-4660-9d15-39bf9883f763 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.206202 Jul 28 04:10:24.537194 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 507/1034] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:24 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:25.559075 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e0f3dfd1-7d93-423e-8c99-d62e1bb84bf0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:25.559723 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e0f3dfd1-7d93-423e-8c99-d62e1bb84bf0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:25.561678 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=8 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:25.567193 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e0f3dfd1-7d93-423e-8c99-d62e1bb84bf0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:25.567657 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e0f3dfd1-7d93-423e-8c99-d62e1bb84bf0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:25.568499 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e0f3dfd1-7d93-423e-8c99-d62e1bb84bf0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:25.569090 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e0f3dfd1-7d93-423e-8c99-d62e1bb84bf0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:25.708024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-e0f3dfd1-7d93-423e-8c99-d62e1bb84bf0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:25.715743 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e0f3dfd1-7d93-423e-8c99-d62e1bb84bf0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.160569 Jul 28 04:10:25.716345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 528/1035] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:25 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:26.299348 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-af636564-4a27-4eb1-b9c2-a71e91c26d55 req-7925511b-5df1-4dac-ad07-26bd3f4138b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d43fe3-52d0-4ff7-b519-10abc0c30c97", "tag": "74dfe64d-b519-4bc9-aa9c-521238e031fb"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:26.311017 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-af636564-4a27-4eb1-b9c2-a71e91c26d55 req-7925511b-5df1-4dac-ad07-26bd3f4138b1 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:26.311494 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-af636564-4a27-4eb1-b9c2-a71e91c26d55 req-7925511b-5df1-4dac-ad07-26bd3f4138b1 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:26.324862 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-af636564-4a27-4eb1-b9c2-a71e91c26d55 req-7925511b-5df1-4dac-ad07-26bd3f4138b1 service nova] Creating event network-changed:74dfe64d-b519-4bc9-aa9c-521238e031fb for instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 on hv-cinder-85127 Jul 28 04:10:26.330103 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-af636564-4a27-4eb1-b9c2-a71e91c26d55 req-7925511b-5df1-4dac-ad07-26bd3f4138b1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173965 Jul 28 04:10:26.330715 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 508/1036] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:26.737021 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-eaff3fa3-5563-4a3f-a55f-fa2a6298831d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:26.737690 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-eaff3fa3-5563-4a3f-a55f-fa2a6298831d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:26.746442 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eaff3fa3-5563-4a3f-a55f-fa2a6298831d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:26.746655 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eaff3fa3-5563-4a3f-a55f-fa2a6298831d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:26.747430 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eaff3fa3-5563-4a3f-a55f-fa2a6298831d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:26.747903 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-eaff3fa3-5563-4a3f-a55f-fa2a6298831d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:26.897610 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-eaff3fa3-5563-4a3f-a55f-fa2a6298831d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:26.905405 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-eaff3fa3-5563-4a3f-a55f-fa2a6298831d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.172316 Jul 28 04:10:26.905984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 529/1037] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:26 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:27.929654 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-343d024f-6c64-477d-a268-4de06c9266ad tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:27.930361 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-343d024f-6c64-477d-a268-4de06c9266ad tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:27.937260 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-343d024f-6c64-477d-a268-4de06c9266ad tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:27.937724 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-343d024f-6c64-477d-a268-4de06c9266ad tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:27.938514 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-343d024f-6c64-477d-a268-4de06c9266ad tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:27.938962 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-343d024f-6c64-477d-a268-4de06c9266ad tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:28.151890 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-343d024f-6c64-477d-a268-4de06c9266ad tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:28.159513 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-343d024f-6c64-477d-a268-4de06c9266ad tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.234825 Jul 28 04:10:28.161017 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 509/1038] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:27 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:29.181828 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-e963622a-b7d6-4cbd-8bca-12a5b8620a54 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:29.182455 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-e963622a-b7d6-4cbd-8bca-12a5b8620a54 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:29.189148 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e963622a-b7d6-4cbd-8bca-12a5b8620a54 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:29.189605 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e963622a-b7d6-4cbd-8bca-12a5b8620a54 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:29.190389 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e963622a-b7d6-4cbd-8bca-12a5b8620a54 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:29.190840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-e963622a-b7d6-4cbd-8bca-12a5b8620a54 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:29.320047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-e963622a-b7d6-4cbd-8bca-12a5b8620a54 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:29.327534 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-e963622a-b7d6-4cbd-8bca-12a5b8620a54 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.149845 Jul 28 04:10:29.328440 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 530/1039] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:29 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:30.348999 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0c62d260-bfc0-4cb1-b20e-0258fb17ade8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:30.349609 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0c62d260-bfc0-4cb1-b20e-0258fb17ade8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:30.356555 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0c62d260-bfc0-4cb1-b20e-0258fb17ade8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:30.357008 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0c62d260-bfc0-4cb1-b20e-0258fb17ade8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:30.357781 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0c62d260-bfc0-4cb1-b20e-0258fb17ade8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:30.358222 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0c62d260-bfc0-4cb1-b20e-0258fb17ade8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:30.494201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0c62d260-bfc0-4cb1-b20e-0258fb17ade8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:30.502884 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0c62d260-bfc0-4cb1-b20e-0258fb17ade8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.157852 Jul 28 04:10:30.503526 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 510/1040] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:30 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:31.524719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-2f00f12e-0272-46e9-a291-718844019f4a tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:31.525360 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-2f00f12e-0272-46e9-a291-718844019f4a tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:31.531937 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f00f12e-0272-46e9-a291-718844019f4a tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.532412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f00f12e-0272-46e9-a291-718844019f4a tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.533176 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f00f12e-0272-46e9-a291-718844019f4a tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.533615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-2f00f12e-0272-46e9-a291-718844019f4a tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.666117 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-2f00f12e-0272-46e9-a291-718844019f4a tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:31.673532 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-2f00f12e-0272-46e9-a291-718844019f4a tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.152649 Jul 28 04:10:31.674103 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 531/1041] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:31 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:32.183265 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-7117a3a3-6359-4d69-ab08-6eafef1c0165 req-812b80c6-6e58-45fe-aa3f-2c7e1f62e24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d43fe3-52d0-4ff7-b519-10abc0c30c97", "name": "network-vif-plugged", "status": "completed", "tag": "74dfe64d-b519-4bc9-aa9c-521238e031fb"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:32.193857 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-7117a3a3-6359-4d69-ab08-6eafef1c0165 req-812b80c6-6e58-45fe-aa3f-2c7e1f62e24a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:32.194322 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-7117a3a3-6359-4d69-ab08-6eafef1c0165 req-812b80c6-6e58-45fe-aa3f-2c7e1f62e24a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:32.206229 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-7117a3a3-6359-4d69-ab08-6eafef1c0165 req-812b80c6-6e58-45fe-aa3f-2c7e1f62e24a service nova] Creating event network-vif-plugged:74dfe64d-b519-4bc9-aa9c-521238e031fb for instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 on hv-cinder-85127 Jul 28 04:10:32.212009 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-7117a3a3-6359-4d69-ab08-6eafef1c0165 req-812b80c6-6e58-45fe-aa3f-2c7e1f62e24a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094740 Jul 28 04:10:32.212614 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 511/1042] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:32.694653 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c054a796-2fbb-4213-93d0-b4ef00e5e8f2 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:32.695262 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c054a796-2fbb-4213-93d0-b4ef00e5e8f2 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:32.701877 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c054a796-2fbb-4213-93d0-b4ef00e5e8f2 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:32.702333 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c054a796-2fbb-4213-93d0-b4ef00e5e8f2 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:32.703104 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c054a796-2fbb-4213-93d0-b4ef00e5e8f2 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:32.703548 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c054a796-2fbb-4213-93d0-b4ef00e5e8f2 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:32.861727 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c054a796-2fbb-4213-93d0-b4ef00e5e8f2 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:32.870145 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c054a796-2fbb-4213-93d0-b4ef00e5e8f2 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1358 microversion: 2.1 time: 0.179986 Jul 28 04:10:32.870727 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 532/1043] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:32 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:33.895135 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-7eef3d5d-49a1-4270-9bcb-815a37a6e7a8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:33.895916 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-7eef3d5d-49a1-4270-9bcb-815a37a6e7a8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:33.902455 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7eef3d5d-49a1-4270-9bcb-815a37a6e7a8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:33.902917 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7eef3d5d-49a1-4270-9bcb-815a37a6e7a8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:33.903701 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7eef3d5d-49a1-4270-9bcb-815a37a6e7a8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:33.904176 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-7eef3d5d-49a1-4270-9bcb-815a37a6e7a8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.037879 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-7eef3d5d-49a1-4270-9bcb-815a37a6e7a8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:34.045538 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-7eef3d5d-49a1-4270-9bcb-815a37a6e7a8 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1548 microversion: 2.1 time: 0.155923 Jul 28 04:10:34.046109 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 512/1044] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:33 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:34.065723 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-28cee6d5-9a71-4cf9-b369-62866cb99277 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:34.066816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-28cee6d5-9a71-4cf9-b369-62866cb99277 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:34.073612 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-28cee6d5-9a71-4cf9-b369-62866cb99277 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.074077 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-28cee6d5-9a71-4cf9-b369-62866cb99277 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.074866 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-28cee6d5-9a71-4cf9-b369-62866cb99277 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.075458 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-28cee6d5-9a71-4cf9-b369-62866cb99277 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.213690 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-28cee6d5-9a71-4cf9-b369-62866cb99277 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:34.221491 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-28cee6d5-9a71-4cf9-b369-62866cb99277 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1548 microversion: 2.1 time: 0.159788 Jul 28 04:10:34.222069 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 533/1045] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:34 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:34.241267 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8758d674-67b3-47e2-9f15-cd52f450133b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:34.246282 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-8758d674-67b3-47e2-9f15-cd52f450133b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:34.247052 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8758d674-67b3-47e2-9f15-cd52f450133b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Searching by: {'deleted': False, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec'} {{(pid=135704) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 04:10:34.254354 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8758d674-67b3-47e2-9f15-cd52f450133b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.254808 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8758d674-67b3-47e2-9f15-cd52f450133b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.255619 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8758d674-67b3-47e2-9f15-cd52f450133b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.256103 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8758d674-67b3-47e2-9f15-cd52f450133b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.346391 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.multi_cell_list [None req-8758d674-67b3-47e2-9f15-cd52f450133b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=135704) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 04:10:34.443682 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8758d674-67b3-47e2-9f15-cd52f450133b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206317 Jul 28 04:10:34.444308 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 513/1046] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Jul 28 04:10:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:34.455617 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0f240055-7335-40da-9684-cbc06816e6e1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:34.456269 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0f240055-7335-40da-9684-cbc06816e6e1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:34.463147 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0f240055-7335-40da-9684-cbc06816e6e1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.463605 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0f240055-7335-40da-9684-cbc06816e6e1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.464420 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0f240055-7335-40da-9684-cbc06816e6e1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.464870 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0f240055-7335-40da-9684-cbc06816e6e1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.596251 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-0f240055-7335-40da-9684-cbc06816e6e1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:34.604278 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0f240055-7335-40da-9684-cbc06816e6e1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1548 microversion: 2.1 time: 0.152494 Jul 28 04:10:34.604851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 534/1047] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:34 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:36.500682 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-6face2c8-43e0-4933-badd-64f80572ef4b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39696e20-fd51-4a4a-8a4b-8999aa96d23d"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:36.503067 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-6face2c8-43e0-4933-badd-64f80572ef4b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:36.509828 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6face2c8-43e0-4933-badd-64f80572ef4b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.510292 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6face2c8-43e0-4933-badd-64f80572ef4b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:36.511076 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6face2c8-43e0-4933-badd-64f80572ef4b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.511525 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-6face2c8-43e0-4933-badd-64f80572ef4b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.327905 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-6face2c8-43e0-4933-badd-64f80572ef4b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "POST /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831131 Jul 28 04:10:37.328569 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 514/1048] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Jul 28 04:10:36 2022] POST /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:44.955248 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-3b65881a-c679-4fd7-a2eb-19e5fa894836 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:44.955843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-3b65881a-c679-4fd7-a2eb-19e5fa894836 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:44.958560 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:44.959349 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=68 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:44.964214 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3b65881a-c679-4fd7-a2eb-19e5fa894836 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:44.964702 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3b65881a-c679-4fd7-a2eb-19e5fa894836 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:44.965492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3b65881a-c679-4fd7-a2eb-19e5fa894836 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:44.965934 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-3b65881a-c679-4fd7-a2eb-19e5fa894836 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:45.101081 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-3b65881a-c679-4fd7-a2eb-19e5fa894836 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:45.109339 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-3b65881a-c679-4fd7-a2eb-19e5fa894836 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1594 microversion: 2.1 time: 0.157972 Jul 28 04:10:45.109911 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 535/1049] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:44 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:47.392908 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:47.393772 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:47.394824 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:47.468688 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-cba03346-a71e-4bd9-9c15-66ead8becb24 req-ea5ea464-5d79-40e8-98fc-7776bf93c53f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d43fe3-52d0-4ff7-b519-10abc0c30c97", "tag": "74dfe64d-b519-4bc9-aa9c-521238e031fb"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:47.480557 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-cba03346-a71e-4bd9-9c15-66ead8becb24 req-ea5ea464-5d79-40e8-98fc-7776bf93c53f service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:47.481011 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-cba03346-a71e-4bd9-9c15-66ead8becb24 req-ea5ea464-5d79-40e8-98fc-7776bf93c53f service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:47.494889 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-cba03346-a71e-4bd9-9c15-66ead8becb24 req-ea5ea464-5d79-40e8-98fc-7776bf93c53f service nova] Creating event network-changed:74dfe64d-b519-4bc9-aa9c-521238e031fb for instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 on hv-cinder-85127 Jul 28 04:10:47.500432 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-cba03346-a71e-4bd9-9c15-66ead8becb24 req-ea5ea464-5d79-40e8-98fc-7776bf93c53f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108792 Jul 28 04:10:47.501039 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 515/1050] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:50.438947 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5052ab52-a489-484c-adfc-b63d7e8c3f01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-860220497"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:50.439479 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5052ab52-a489-484c-adfc-b63d7e8c3f01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:50.446406 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5052ab52-a489-484c-adfc-b63d7e8c3f01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:50.446861 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5052ab52-a489-484c-adfc-b63d7e8c3f01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:50.447652 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5052ab52-a489-484c-adfc-b63d7e8c3f01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:50.448136 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5052ab52-a489-484c-adfc-b63d7e8c3f01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:50.587705 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.network.security_group_api [None req-5052ab52-a489-484c-adfc-b63d7e8c3f01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Adding security group 7346ab17-480e-4591-8c6f-a0c25be76dc3 to port 74dfe64d-b519-4bc9-aa9c-521238e031fb Jul 28 04:10:51.106390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5052ab52-a489-484c-adfc-b63d7e8c3f01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "POST /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/action" status: 202 len: 0 microversion: 2.1 time: 0.671405 Jul 28 04:10:51.111623 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 536/1051] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:10:50 2022] POST /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/action => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:10:51.114714 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-60cb211b-3498-4d23-8aea-09b0eba3552c req-4ff500a5-7fd9-4360-9b5d-a115ec6dd480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d43fe3-52d0-4ff7-b519-10abc0c30c97", "tag": "74dfe64d-b519-4bc9-aa9c-521238e031fb"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:51.118990 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c6a61b34-fb03-4bd0-85e9-63c6c5d51c84 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:51.118990 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c6a61b34-fb03-4bd0-85e9-63c6c5d51c84 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:51.126173 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c6a61b34-fb03-4bd0-85e9-63c6c5d51c84 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:51.126924 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c6a61b34-fb03-4bd0-85e9-63c6c5d51c84 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:51.127727 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c6a61b34-fb03-4bd0-85e9-63c6c5d51c84 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:51.128190 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c6a61b34-fb03-4bd0-85e9-63c6c5d51c84 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:51.143755 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-60cb211b-3498-4d23-8aea-09b0eba3552c req-4ff500a5-7fd9-4360-9b5d-a115ec6dd480 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:51.144527 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-60cb211b-3498-4d23-8aea-09b0eba3552c req-4ff500a5-7fd9-4360-9b5d-a115ec6dd480 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:51.162040 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-60cb211b-3498-4d23-8aea-09b0eba3552c req-4ff500a5-7fd9-4360-9b5d-a115ec6dd480 service nova] Creating event network-changed:74dfe64d-b519-4bc9-aa9c-521238e031fb for instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 on hv-cinder-85127 Jul 28 04:10:51.168201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-60cb211b-3498-4d23-8aea-09b0eba3552c req-4ff500a5-7fd9-4360-9b5d-a115ec6dd480 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057422 Jul 28 04:10:51.171726 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 516/1052] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:51.308275 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c6a61b34-fb03-4bd0-85e9-63c6c5d51c84 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:51.321963 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c6a61b34-fb03-4bd0-85e9-63c6c5d51c84 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1758 microversion: 2.1 time: 0.207655 Jul 28 04:10:51.323232 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 537/1053] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:51 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1758 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:06.427704 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-515337a5-2e98-43c2-ab77-ccb324da8f10 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:06.429970 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-515337a5-2e98-43c2-ab77-ccb324da8f10 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:06.437072 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-515337a5-2e98-43c2-ab77-ccb324da8f10 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:06.437875 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-515337a5-2e98-43c2-ab77-ccb324da8f10 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:06.438748 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-515337a5-2e98-43c2-ab77-ccb324da8f10 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:06.438936 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-515337a5-2e98-43c2-ab77-ccb324da8f10 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:06.658930 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-515337a5-2e98-43c2-ab77-ccb324da8f10 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "POST /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/action" status: 202 len: 0 microversion: 2.1 time: 0.236178 Jul 28 04:11:06.659727 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 517/1054] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:11:06 2022] POST /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:11:06.669626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5bb8480c-4060-41b7-8b2b-7eebd6176bc0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:06.673137 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5bb8480c-4060-41b7-8b2b-7eebd6176bc0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:06.673824 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=6 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:06.674721 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=16 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:06.679823 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bb8480c-4060-41b7-8b2b-7eebd6176bc0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:06.680325 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bb8480c-4060-41b7-8b2b-7eebd6176bc0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:06.681747 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bb8480c-4060-41b7-8b2b-7eebd6176bc0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:06.682260 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5bb8480c-4060-41b7-8b2b-7eebd6176bc0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:06.843793 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5bb8480c-4060-41b7-8b2b-7eebd6176bc0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:06.852092 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5bb8480c-4060-41b7-8b2b-7eebd6176bc0 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1750 microversion: 2.1 time: 0.186927 Jul 28 04:11:06.852800 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 538/1055] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:06 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:07.876176 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-396a75be-6107-4be6-9605-83accd5acd20 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:07.876886 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-396a75be-6107-4be6-9605-83accd5acd20 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:07.883310 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-396a75be-6107-4be6-9605-83accd5acd20 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:07.883766 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-396a75be-6107-4be6-9605-83accd5acd20 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:07.885125 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-396a75be-6107-4be6-9605-83accd5acd20 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:07.885570 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-396a75be-6107-4be6-9605-83accd5acd20 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:08.041516 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-396a75be-6107-4be6-9605-83accd5acd20 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:08.050120 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-396a75be-6107-4be6-9605-83accd5acd20 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1750 microversion: 2.1 time: 0.178786 Jul 28 04:11:08.050698 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 518/1056] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:07 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:09.072451 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-8fed72d0-6228-46eb-818f-55004ce4a107 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:09.073077 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-8fed72d0-6228-46eb-818f-55004ce4a107 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:09.079917 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8fed72d0-6228-46eb-818f-55004ce4a107 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:09.080416 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8fed72d0-6228-46eb-818f-55004ce4a107 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:09.081202 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8fed72d0-6228-46eb-818f-55004ce4a107 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:09.081647 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-8fed72d0-6228-46eb-818f-55004ce4a107 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:09.229615 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-8fed72d0-6228-46eb-818f-55004ce4a107 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:09.238035 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-8fed72d0-6228-46eb-818f-55004ce4a107 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1755 microversion: 2.1 time: 0.169732 Jul 28 04:11:09.238545 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 539/1057] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:09 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:10.261690 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-5f887e59-fa52-4380-a8f8-26c27c085f16 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:10.262524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-5f887e59-fa52-4380-a8f8-26c27c085f16 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:10.269214 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5f887e59-fa52-4380-a8f8-26c27c085f16 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:10.269671 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5f887e59-fa52-4380-a8f8-26c27c085f16 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:10.270458 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5f887e59-fa52-4380-a8f8-26c27c085f16 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:10.270901 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-5f887e59-fa52-4380-a8f8-26c27c085f16 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:10.420482 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-5f887e59-fa52-4380-a8f8-26c27c085f16 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:10.428434 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-5f887e59-fa52-4380-a8f8-26c27c085f16 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1755 microversion: 2.1 time: 0.171620 Jul 28 04:11:10.429002 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 519/1058] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:10 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:11.451647 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-48be9fb5-bcdb-4779-bcf5-f09e1ecadb0b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:11.452296 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-48be9fb5-bcdb-4779-bcf5-f09e1ecadb0b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:11.459015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-48be9fb5-bcdb-4779-bcf5-f09e1ecadb0b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:11.459475 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-48be9fb5-bcdb-4779-bcf5-f09e1ecadb0b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:11.460301 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-48be9fb5-bcdb-4779-bcf5-f09e1ecadb0b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:11.460751 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-48be9fb5-bcdb-4779-bcf5-f09e1ecadb0b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:11.614593 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-48be9fb5-bcdb-4779-bcf5-f09e1ecadb0b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:11.623088 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-48be9fb5-bcdb-4779-bcf5-f09e1ecadb0b tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1755 microversion: 2.1 time: 0.175297 Jul 28 04:11:11.623664 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 540/1059] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:11 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:12.344235 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1860207383", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-743574221", "security_groups": [{"name": "tempest-secgroup-smoke-1803004242"}], "block_device_mapping_v2": [{"uuid": "6b6eaae0-c4aa-487e-9821-92873e02dc14", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "672eb351-e67a-4327-be23-b1a7215130a6"}]}} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:12.465612 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.network.neutron [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] validate_networks() for [('672eb351-e67a-4327-be23-b1a7215130a6', None, None, None, None, None)] {{(pid=135704) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:11:12.644486 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-7ffeb66d-6695-4d85-af22-b002448df79d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:12.645127 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-7ffeb66d-6695-4d85-af22-b002448df79d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:12.652086 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7ffeb66d-6695-4d85-af22-b002448df79d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:12.652543 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7ffeb66d-6695-4d85-af22-b002448df79d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:12.653449 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7ffeb66d-6695-4d85-af22-b002448df79d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:12.653826 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-7ffeb66d-6695-4d85-af22-b002448df79d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:12.807398 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-7ffeb66d-6695-4d85-af22-b002448df79d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:12.816031 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-7ffeb66d-6695-4d85-af22-b002448df79d tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1755 microversion: 2.1 time: 0.175394 Jul 28 04:11:12.816626 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 541/1060] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:12 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:12.858407 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Flavor limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:11:12.858817 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Image limits 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:11:12.859289 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Flavor pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:11:12.859690 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Image pref 0:0:0 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:11:12.860127 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.virt.hardware [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=135704) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:11:12.869722 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:12.870164 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:12.870961 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:12.871429 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:12.888473 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Getting quotas for project 9aa592e1b58f4804ad264f0cd721b1ca. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:11:12.892340 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.quota [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Getting quotas for user 44734ee22727449fafcd470798c10abd and project 9aa592e1b58f4804ad264f0cd721b1ca. Resources: {'cores', 'instances', 'ram'} {{(pid=135704) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:11:12.949665 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Going to run 1 instances... {{(pid=135704) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:11:12.951818 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b6eaae0-c4aa-487e-9821-92873e02dc14',volume_size=None,volume_type=None)] {{(pid=135704) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:11:13.326369 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-8534a8e9-d2f6-40b4-ab18-81d5c347799f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.986063 Jul 28 04:11:13.327237 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 520/1061] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Jul 28 04:11:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:11:13.338889 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-d7f4ef52-6405-4d65-b2f3-25dd280de964 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:13.339510 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-d7f4ef52-6405-4d65-b2f3-25dd280de964 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:13.394734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-d7f4ef52-6405-4d65-b2f3-25dd280de964 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:13.402128 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-d7f4ef52-6405-4d65-b2f3-25dd280de964 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1094 microversion: 2.1 time: 0.067961 Jul 28 04:11:13.402889 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 542/1062] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:13 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:13.839443 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ffb02748-e52f-4cd0-9cca-bdc2dd5e59c1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:13.840168 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ffb02748-e52f-4cd0-9cca-bdc2dd5e59c1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:13.846283 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ffb02748-e52f-4cd0-9cca-bdc2dd5e59c1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:13.846739 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ffb02748-e52f-4cd0-9cca-bdc2dd5e59c1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:13.847512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ffb02748-e52f-4cd0-9cca-bdc2dd5e59c1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:13.847974 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ffb02748-e52f-4cd0-9cca-bdc2dd5e59c1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:14.008170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ffb02748-e52f-4cd0-9cca-bdc2dd5e59c1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:14.017546 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ffb02748-e52f-4cd0-9cca-bdc2dd5e59c1 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1755 microversion: 2.1 time: 0.183201 Jul 28 04:11:14.018055 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 521/1063] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:13 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:14.423976 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5123f80a-7fd1-4014-a954-4a32e7d704b4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:14.424694 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5123f80a-7fd1-4014-a954-4a32e7d704b4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:14.433089 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5123f80a-7fd1-4014-a954-4a32e7d704b4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:14.433556 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5123f80a-7fd1-4014-a954-4a32e7d704b4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:14.434361 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5123f80a-7fd1-4014-a954-4a32e7d704b4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:14.434797 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5123f80a-7fd1-4014-a954-4a32e7d704b4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:14.503422 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5123f80a-7fd1-4014-a954-4a32e7d704b4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:14.512851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5123f80a-7fd1-4014-a954-4a32e7d704b4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1144 microversion: 2.1 time: 0.092930 Jul 28 04:11:14.513451 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 543/1064] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:14 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:15.040628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-e5026500-7fea-48e0-83a4-70193214131f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:15.041362 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-e5026500-7fea-48e0-83a4-70193214131f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:15.048247 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5026500-7fea-48e0-83a4-70193214131f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:15.048699 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5026500-7fea-48e0-83a4-70193214131f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:15.049484 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5026500-7fea-48e0-83a4-70193214131f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:15.049925 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-e5026500-7fea-48e0-83a4-70193214131f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:15.232943 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-e5026500-7fea-48e0-83a4-70193214131f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:15.241388 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-e5026500-7fea-48e0-83a4-70193214131f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1755 microversion: 2.1 time: 0.204951 Jul 28 04:11:15.242081 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 522/1065] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:15 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:15.537107 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-273179a5-224d-4ad0-9ed7-e1af8a9485ec tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:15.537761 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-273179a5-224d-4ad0-9ed7-e1af8a9485ec tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:15.545713 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-273179a5-224d-4ad0-9ed7-e1af8a9485ec tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:15.550907 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-273179a5-224d-4ad0-9ed7-e1af8a9485ec tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:15.550907 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-273179a5-224d-4ad0-9ed7-e1af8a9485ec tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:15.550907 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-273179a5-224d-4ad0-9ed7-e1af8a9485ec tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:15.644592 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-273179a5-224d-4ad0-9ed7-e1af8a9485ec tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:15.654180 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-273179a5-224d-4ad0-9ed7-e1af8a9485ec tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1210 microversion: 2.1 time: 0.123228 Jul 28 04:11:15.654902 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 544/1066] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:15 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:16.267306 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-31d6ff73-8d6c-4483-8cff-d8ee76822617 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:16.268988 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-31d6ff73-8d6c-4483-8cff-d8ee76822617 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:16.284512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-31d6ff73-8d6c-4483-8cff-d8ee76822617 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:16.284512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-31d6ff73-8d6c-4483-8cff-d8ee76822617 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:16.284512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-31d6ff73-8d6c-4483-8cff-d8ee76822617 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:16.284512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-31d6ff73-8d6c-4483-8cff-d8ee76822617 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:16.482986 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-31d6ff73-8d6c-4483-8cff-d8ee76822617 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:16.492866 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-31d6ff73-8d6c-4483-8cff-d8ee76822617 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1755 microversion: 2.1 time: 0.231980 Jul 28 04:11:16.496883 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 523/1067] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:16 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1755 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:16.676311 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-94b3cb0d-6520-42f1-bff3-4863cbce0915 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:16.676894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-94b3cb0d-6520-42f1-bff3-4863cbce0915 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:16.684349 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-94b3cb0d-6520-42f1-bff3-4863cbce0915 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:16.684816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-94b3cb0d-6520-42f1-bff3-4863cbce0915 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:16.685606 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-94b3cb0d-6520-42f1-bff3-4863cbce0915 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:16.686112 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-94b3cb0d-6520-42f1-bff3-4863cbce0915 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:16.833477 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-94b3cb0d-6520-42f1-bff3-4863cbce0915 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:16.843006 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-94b3cb0d-6520-42f1-bff3-4863cbce0915 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1278 microversion: 2.1 time: 0.170773 Jul 28 04:11:16.843617 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 545/1068] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:16 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:17.307401 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-b505e59b-e05a-4a5e-bd38-8848a17d4b08 req-1baf415b-60c8-4ccc-b66e-631ccc1c459c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42", "tag": "dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:17.337440 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-b505e59b-e05a-4a5e-bd38-8848a17d4b08 req-1baf415b-60c8-4ccc-b66e-631ccc1c459c service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.338198 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-b505e59b-e05a-4a5e-bd38-8848a17d4b08 req-1baf415b-60c8-4ccc-b66e-631ccc1c459c service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:17.353571 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-b505e59b-e05a-4a5e-bd38-8848a17d4b08 req-1baf415b-60c8-4ccc-b66e-631ccc1c459c service nova] Creating event network-changed:dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc for instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 on hv-cinder-85127 Jul 28 04:11:17.360617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-b505e59b-e05a-4a5e-bd38-8848a17d4b08 req-1baf415b-60c8-4ccc-b66e-631ccc1c459c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057093 Jul 28 04:11:17.360617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 524/1069] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:11:17.515512 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-589a9590-f61d-49a9-affe-faba9e1c3e32 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:17.516338 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-589a9590-f61d-49a9-affe-faba9e1c3e32 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:17.522505 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-589a9590-f61d-49a9-affe-faba9e1c3e32 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.523042 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-589a9590-f61d-49a9-affe-faba9e1c3e32 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:17.523903 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-589a9590-f61d-49a9-affe-faba9e1c3e32 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.524494 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-589a9590-f61d-49a9-affe-faba9e1c3e32 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:17.691321 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-589a9590-f61d-49a9-affe-faba9e1c3e32 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:17.700251 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-589a9590-f61d-49a9-affe-faba9e1c3e32 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1755 microversion: 2.1 time: 0.188491 Jul 28 04:11:17.700840 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 546/1070] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:17 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:17.865512 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0fc1c1ba-3cf6-4d7e-bc26-ee0873296160 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:17.866144 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0fc1c1ba-3cf6-4d7e-bc26-ee0873296160 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:17.873413 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fc1c1ba-3cf6-4d7e-bc26-ee0873296160 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.873871 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fc1c1ba-3cf6-4d7e-bc26-ee0873296160 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:17.874656 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fc1c1ba-3cf6-4d7e-bc26-ee0873296160 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.875102 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0fc1c1ba-3cf6-4d7e-bc26-ee0873296160 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:18.101666 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0fc1c1ba-3cf6-4d7e-bc26-ee0873296160 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:18.109849 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0fc1c1ba-3cf6-4d7e-bc26-ee0873296160 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.248651 Jul 28 04:11:18.110426 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 525/1071] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:17 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:18.721492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-4319e6b0-7787-45ad-bf27-1c7d3d5dc085 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:18.722137 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-4319e6b0-7787-45ad-bf27-1c7d3d5dc085 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:18.728423 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4319e6b0-7787-45ad-bf27-1c7d3d5dc085 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:18.728875 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4319e6b0-7787-45ad-bf27-1c7d3d5dc085 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:18.729639 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4319e6b0-7787-45ad-bf27-1c7d3d5dc085 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:18.730076 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-4319e6b0-7787-45ad-bf27-1c7d3d5dc085 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:18.875547 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-4319e6b0-7787-45ad-bf27-1c7d3d5dc085 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:18.883829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-4319e6b0-7787-45ad-bf27-1c7d3d5dc085 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1755 microversion: 2.1 time: 0.166125 Jul 28 04:11:18.885517 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 547/1072] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:18 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:19.132023 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1353f824-3039-42fc-90c0-a9b6e5f0e444 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:19.132760 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1353f824-3039-42fc-90c0-a9b6e5f0e444 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:19.140188 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1353f824-3039-42fc-90c0-a9b6e5f0e444 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:19.140647 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1353f824-3039-42fc-90c0-a9b6e5f0e444 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:19.141437 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1353f824-3039-42fc-90c0-a9b6e5f0e444 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:19.141878 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1353f824-3039-42fc-90c0-a9b6e5f0e444 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:19.273767 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1353f824-3039-42fc-90c0-a9b6e5f0e444 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:19.281200 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1353f824-3039-42fc-90c0-a9b6e5f0e444 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.153085 Jul 28 04:11:19.281753 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 526/1073] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:19 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:19.906652 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-1febf126-7c5b-4199-8757-4f6e0f6893d9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:19.907199 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-1febf126-7c5b-4199-8757-4f6e0f6893d9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:19.913777 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1febf126-7c5b-4199-8757-4f6e0f6893d9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:19.914234 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1febf126-7c5b-4199-8757-4f6e0f6893d9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:19.915014 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1febf126-7c5b-4199-8757-4f6e0f6893d9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:19.916141 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-1febf126-7c5b-4199-8757-4f6e0f6893d9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:20.060367 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-1febf126-7c5b-4199-8757-4f6e0f6893d9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:20.069139 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-1febf126-7c5b-4199-8757-4f6e0f6893d9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1758 microversion: 2.1 time: 0.166468 Jul 28 04:11:20.069725 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 548/1074] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:19 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:20.301700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0b444947-40ed-42bf-a2ef-9d7dee151af4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:20.302308 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0b444947-40ed-42bf-a2ef-9d7dee151af4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:20.309058 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0b444947-40ed-42bf-a2ef-9d7dee151af4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:20.309508 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0b444947-40ed-42bf-a2ef-9d7dee151af4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:20.310266 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0b444947-40ed-42bf-a2ef-9d7dee151af4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:20.310700 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0b444947-40ed-42bf-a2ef-9d7dee151af4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:20.443394 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0b444947-40ed-42bf-a2ef-9d7dee151af4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:20.451553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0b444947-40ed-42bf-a2ef-9d7dee151af4 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.153767 Jul 28 04:11:20.452150 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 527/1075] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:20 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:21.472936 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-6700ee11-f8d9-4aa7-88ef-761ad4668e5d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:21.473547 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-6700ee11-f8d9-4aa7-88ef-761ad4668e5d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:21.480920 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6700ee11-f8d9-4aa7-88ef-761ad4668e5d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:21.481377 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6700ee11-f8d9-4aa7-88ef-761ad4668e5d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:21.482162 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6700ee11-f8d9-4aa7-88ef-761ad4668e5d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:21.482612 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-6700ee11-f8d9-4aa7-88ef-761ad4668e5d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:21.620008 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-6700ee11-f8d9-4aa7-88ef-761ad4668e5d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:21.627489 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-6700ee11-f8d9-4aa7-88ef-761ad4668e5d tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.158516 Jul 28 04:11:21.628079 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 549/1076] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:21 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:22.648428 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0179e6d6-eb41-4d0c-bdb5-d74542695377 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:22.648955 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0179e6d6-eb41-4d0c-bdb5-d74542695377 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:22.656088 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0179e6d6-eb41-4d0c-bdb5-d74542695377 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:22.656553 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0179e6d6-eb41-4d0c-bdb5-d74542695377 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:22.657328 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0179e6d6-eb41-4d0c-bdb5-d74542695377 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:22.657771 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0179e6d6-eb41-4d0c-bdb5-d74542695377 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:22.789530 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0179e6d6-eb41-4d0c-bdb5-d74542695377 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:22.797169 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0179e6d6-eb41-4d0c-bdb5-d74542695377 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.153042 Jul 28 04:11:22.797731 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 528/1077] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:22 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:23.818914 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b229964d-5d92-4e25-8e99-482d65eb1dcd tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:23.819587 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b229964d-5d92-4e25-8e99-482d65eb1dcd tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:23.821892 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell0:SELECT=2 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:23.827244 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b229964d-5d92-4e25-8e99-482d65eb1dcd tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.827704 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b229964d-5d92-4e25-8e99-482d65eb1dcd tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.828520 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b229964d-5d92-4e25-8e99-482d65eb1dcd tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.828966 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b229964d-5d92-4e25-8e99-482d65eb1dcd tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.964572 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b229964d-5d92-4e25-8e99-482d65eb1dcd tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:23.972345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b229964d-5d92-4e25-8e99-482d65eb1dcd tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.157533 Jul 28 04:11:23.976082 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 550/1078] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:23 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:24.993499 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-956e68ed-499e-41d0-a352-52a20fb53966 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:24.994772 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-956e68ed-499e-41d0-a352-52a20fb53966 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:24.997273 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=2 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:24.997955 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell0:SELECT=6 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:25.003265 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-956e68ed-499e-41d0-a352-52a20fb53966 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.003723 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-956e68ed-499e-41d0-a352-52a20fb53966 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.004538 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-956e68ed-499e-41d0-a352-52a20fb53966 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.005039 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-956e68ed-499e-41d0-a352-52a20fb53966 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.135321 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-956e68ed-499e-41d0-a352-52a20fb53966 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:25.142950 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-956e68ed-499e-41d0-a352-52a20fb53966 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.153666 Jul 28 04:11:25.143514 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 529/1079] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:24 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:26.163237 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-f4c59fae-5d50-494b-a981-419d227959ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:26.163872 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-f4c59fae-5d50-494b-a981-419d227959ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:26.170897 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f4c59fae-5d50-494b-a981-419d227959ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:26.171370 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f4c59fae-5d50-494b-a981-419d227959ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:26.172188 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f4c59fae-5d50-494b-a981-419d227959ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:26.172630 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-f4c59fae-5d50-494b-a981-419d227959ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:26.309546 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-f4c59fae-5d50-494b-a981-419d227959ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:26.317412 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-f4c59fae-5d50-494b-a981-419d227959ea tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.158125 Jul 28 04:11:26.317998 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 551/1080] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:26 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:27.344219 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-b099301b-6d15-495e-8c08-b0353f8d4076 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:27.344830 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-b099301b-6d15-495e-8c08-b0353f8d4076 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:27.351309 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b099301b-6d15-495e-8c08-b0353f8d4076 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:27.351758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b099301b-6d15-495e-8c08-b0353f8d4076 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:27.352554 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b099301b-6d15-495e-8c08-b0353f8d4076 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:27.352991 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-b099301b-6d15-495e-8c08-b0353f8d4076 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:27.487918 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-b099301b-6d15-495e-8c08-b0353f8d4076 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:27.496332 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-b099301b-6d15-495e-8c08-b0353f8d4076 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.155559 Jul 28 04:11:27.497171 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 530/1081] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:27 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:28.386286 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-00b3c759-a073-4d7b-b060-9bedd443399f req-00bf593c-8580-424e-b81b-966a59b2623a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42", "name": "network-vif-plugged", "status": "completed", "tag": "dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:28.397504 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-00b3c759-a073-4d7b-b060-9bedd443399f req-00bf593c-8580-424e-b81b-966a59b2623a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:28.397950 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-00b3c759-a073-4d7b-b060-9bedd443399f req-00bf593c-8580-424e-b81b-966a59b2623a service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:28.409665 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-00b3c759-a073-4d7b-b060-9bedd443399f req-00bf593c-8580-424e-b81b-966a59b2623a service nova] Creating event network-vif-plugged:dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc for instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 on hv-cinder-85127 Jul 28 04:11:28.415036 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-00b3c759-a073-4d7b-b060-9bedd443399f req-00bf593c-8580-424e-b81b-966a59b2623a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032472 Jul 28 04:11:28.415942 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 552/1082] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:28.517971 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-0b5ac286-084f-40a8-8856-9555b302866b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:28.518548 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-0b5ac286-084f-40a8-8856-9555b302866b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:28.525574 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0b5ac286-084f-40a8-8856-9555b302866b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:28.526028 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0b5ac286-084f-40a8-8856-9555b302866b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:28.527077 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0b5ac286-084f-40a8-8856-9555b302866b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:28.528339 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-0b5ac286-084f-40a8-8856-9555b302866b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:28.664449 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-0b5ac286-084f-40a8-8856-9555b302866b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:28.672765 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-0b5ac286-084f-40a8-8856-9555b302866b tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.158611 Jul 28 04:11:28.673337 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 531/1083] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:28 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:29.693797 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-17846f97-a5fb-4c92-8ddf-2b453ac5e7b7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:29.694531 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-17846f97-a5fb-4c92-8ddf-2b453ac5e7b7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:29.701496 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-17846f97-a5fb-4c92-8ddf-2b453ac5e7b7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:29.701955 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-17846f97-a5fb-4c92-8ddf-2b453ac5e7b7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:29.702736 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-17846f97-a5fb-4c92-8ddf-2b453ac5e7b7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:29.703211 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-17846f97-a5fb-4c92-8ddf-2b453ac5e7b7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:29.841902 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-17846f97-a5fb-4c92-8ddf-2b453ac5e7b7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:29.849512 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-17846f97-a5fb-4c92-8ddf-2b453ac5e7b7 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1266 microversion: 2.1 time: 0.159926 Jul 28 04:11:29.850097 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 553/1084] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:29 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:30.870720 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ceaa4e69-8233-429a-82ad-ef4f69cf4f64 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:30.871350 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ceaa4e69-8233-429a-82ad-ef4f69cf4f64 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:30.877905 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ceaa4e69-8233-429a-82ad-ef4f69cf4f64 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.878351 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ceaa4e69-8233-429a-82ad-ef4f69cf4f64 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:30.879113 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ceaa4e69-8233-429a-82ad-ef4f69cf4f64 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.879541 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ceaa4e69-8233-429a-82ad-ef4f69cf4f64 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:31.011920 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ceaa4e69-8233-429a-82ad-ef4f69cf4f64 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:31.019449 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ceaa4e69-8233-429a-82ad-ef4f69cf4f64 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1452 microversion: 2.1 time: 0.152886 Jul 28 04:11:31.020035 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 532/1085] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:30 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:31.039813 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-b9d163b0-dbcf-4ac8-b5f3-f05ffcf7a016 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:31.040462 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-b9d163b0-dbcf-4ac8-b5f3-f05ffcf7a016 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:31.047646 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b9d163b0-dbcf-4ac8-b5f3-f05ffcf7a016 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:31.048147 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b9d163b0-dbcf-4ac8-b5f3-f05ffcf7a016 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:31.048929 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b9d163b0-dbcf-4ac8-b5f3-f05ffcf7a016 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:31.049371 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-b9d163b0-dbcf-4ac8-b5f3-f05ffcf7a016 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:31.181096 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-b9d163b0-dbcf-4ac8-b5f3-f05ffcf7a016 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:31.189283 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-b9d163b0-dbcf-4ac8-b5f3-f05ffcf7a016 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1452 microversion: 2.1 time: 0.153239 Jul 28 04:11:31.189858 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 554/1086] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:31 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:33.116990 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-954ff880-ed4b-4888-bbbc-1287cc7bac2b req-471192e4-0169-4094-a06d-680caa00f58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42", "tag": "dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:33.127773 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-954ff880-ed4b-4888-bbbc-1287cc7bac2b req-471192e4-0169-4094-a06d-680caa00f58d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:33.128373 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-954ff880-ed4b-4888-bbbc-1287cc7bac2b req-471192e4-0169-4094-a06d-680caa00f58d service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:33.132537 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:33.139993 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-954ff880-ed4b-4888-bbbc-1287cc7bac2b req-471192e4-0169-4094-a06d-680caa00f58d service nova] Creating event network-changed:dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc for instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 on hv-cinder-85127 Jul 28 04:11:33.145554 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-954ff880-ed4b-4888-bbbc-1287cc7bac2b req-471192e4-0169-4094-a06d-680caa00f58d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Jul 28 04:11:33.146630 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 533/1087] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:53.023570 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-ff6c052a-517f-48a5-806e-109439afa037 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-860220497"}} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:53.024287 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-ff6c052a-517f-48a5-806e-109439afa037 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:53.026468 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=36 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:53.027177 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=92 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:53.032770 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ff6c052a-517f-48a5-806e-109439afa037 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:53.033281 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ff6c052a-517f-48a5-806e-109439afa037 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:53.034088 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ff6c052a-517f-48a5-806e-109439afa037 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:53.034534 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-ff6c052a-517f-48a5-806e-109439afa037 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:53.170051 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.network.security_group_api [None req-ff6c052a-517f-48a5-806e-109439afa037 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Removing security group 7346ab17-480e-4591-8c6f-a0c25be76dc3 from port 74dfe64d-b519-4bc9-aa9c-521238e031fb Jul 28 04:11:53.591477 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-ff6c052a-517f-48a5-806e-109439afa037 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "POST /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/action" status: 202 len: 0 microversion: 2.1 time: 0.571433 Jul 28 04:11:53.605946 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 555/1088] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Jul 28 04:11:53 2022] POST /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:11:53.610198 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-ecf6478f-8dbe-4bd9-aa32-d7ae38f3adf2 req-4e3b926a-8617-4206-b758-1eca158e7ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d43fe3-52d0-4ff7-b519-10abc0c30c97", "tag": "74dfe64d-b519-4bc9-aa9c-521238e031fb"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:53.622076 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:53.624939 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-ecf6478f-8dbe-4bd9-aa32-d7ae38f3adf2 req-4e3b926a-8617-4206-b758-1eca158e7ad6 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:53.625674 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-ecf6478f-8dbe-4bd9-aa32-d7ae38f3adf2 req-4e3b926a-8617-4206-b758-1eca158e7ad6 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:53.641195 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-ecf6478f-8dbe-4bd9-aa32-d7ae38f3adf2 req-4e3b926a-8617-4206-b758-1eca158e7ad6 service nova] Creating event network-changed:74dfe64d-b519-4bc9-aa9c-521238e031fb for instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 on hv-cinder-85127 Jul 28 04:11:53.648928 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-ecf6478f-8dbe-4bd9-aa32-d7ae38f3adf2 req-4e3b926a-8617-4206-b758-1eca158e7ad6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050463 Jul 28 04:11:53.651628 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 534/1089] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:55.095224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5a806dcf-63fa-4f52-830a-a165584223c9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:55.095876 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5a806dcf-63fa-4f52-830a-a165584223c9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:55.102997 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a806dcf-63fa-4f52-830a-a165584223c9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:55.103984 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a806dcf-63fa-4f52-830a-a165584223c9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:55.104592 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a806dcf-63fa-4f52-830a-a165584223c9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:55.105115 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a806dcf-63fa-4f52-830a-a165584223c9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:55.197442 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.objects.instance [None req-5a806dcf-63fa-4f52-830a-a165584223c9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lazy-loading 'services' on Instance uuid 99d43fe3-52d0-4ff7-b519-10abc0c30c97 {{(pid=135703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:11:55.500632 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5a806dcf-63fa-4f52-830a-a165584223c9 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "DELETE /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments/39696e20-fd51-4a4a-8a4b-8999aa96d23d" status: 202 len: 0 microversion: 2.1 time: 0.409948 Jul 28 04:11:55.501245 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 556/1090] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:11:55 2022] DELETE /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments/39696e20-fd51-4a4a-8a4b-8999aa96d23d => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:11:55.510397 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-3a7d2dce-6b58-4a19-a2d2-1a392ed45879 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:55.512740 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-3a7d2dce-6b58-4a19-a2d2-1a392ed45879 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:55.521615 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3a7d2dce-6b58-4a19-a2d2-1a392ed45879 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:55.522063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3a7d2dce-6b58-4a19-a2d2-1a392ed45879 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:55.522833 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3a7d2dce-6b58-4a19-a2d2-1a392ed45879 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:55.523272 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-3a7d2dce-6b58-4a19-a2d2-1a392ed45879 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:55.555891 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-3a7d2dce-6b58-4a19-a2d2-1a392ed45879 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049686 Jul 28 04:11:55.556513 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 535/1091] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:11:55 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:55.674536 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-136f3d7b-8df7-4ec4-a932-ad8bd3a9d434 req-58d569e5-f3ba-4b84-b48b-288374025274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d43fe3-52d0-4ff7-b519-10abc0c30c97", "tag": "74dfe64d-b519-4bc9-aa9c-521238e031fb"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:55.684400 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-136f3d7b-8df7-4ec4-a932-ad8bd3a9d434 req-58d569e5-f3ba-4b84-b48b-288374025274 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:55.684851 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-136f3d7b-8df7-4ec4-a932-ad8bd3a9d434 req-58d569e5-f3ba-4b84-b48b-288374025274 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:55.698082 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-136f3d7b-8df7-4ec4-a932-ad8bd3a9d434 req-58d569e5-f3ba-4b84-b48b-288374025274 service nova] Creating event network-changed:74dfe64d-b519-4bc9-aa9c-521238e031fb for instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 on hv-cinder-85127 Jul 28 04:11:55.703170 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-136f3d7b-8df7-4ec4-a932-ad8bd3a9d434 req-58d569e5-f3ba-4b84-b48b-288374025274 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033405 Jul 28 04:11:55.703762 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 557/1092] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:56.568693 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c2db5f50-5ca3-4b7a-82c9-c248c6ecaab4 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:56.570994 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c2db5f50-5ca3-4b7a-82c9-c248c6ecaab4 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:56.579232 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c2db5f50-5ca3-4b7a-82c9-c248c6ecaab4 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:56.579701 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c2db5f50-5ca3-4b7a-82c9-c248c6ecaab4 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:56.580535 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c2db5f50-5ca3-4b7a-82c9-c248c6ecaab4 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:56.580979 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c2db5f50-5ca3-4b7a-82c9-c248c6ecaab4 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:56.611978 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c2db5f50-5ca3-4b7a-82c9-c248c6ecaab4 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047265 Jul 28 04:11:56.612668 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 536/1093] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:11:56 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:57.627345 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-50f5c4af-17f7-4d54-bc30-c8963b6bcb01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:57.629594 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-50f5c4af-17f7-4d54-bc30-c8963b6bcb01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:57.636099 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-50f5c4af-17f7-4d54-bc30-c8963b6bcb01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:57.641294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-50f5c4af-17f7-4d54-bc30-c8963b6bcb01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:57.641294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-50f5c4af-17f7-4d54-bc30-c8963b6bcb01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:57.641294 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-50f5c4af-17f7-4d54-bc30-c8963b6bcb01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:57.666694 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-50f5c4af-17f7-4d54-bc30-c8963b6bcb01 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045603 Jul 28 04:11:57.667291 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 558/1094] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Jul 28 04:11:57 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:11:57.678621 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:57.679170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:57.685304 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:57.685754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:57.687196 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:57.687640 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:57.764326 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] HTTP exception thrown: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 is not attached to volume 39696e20-fd51-4a4a-8a4b-8999aa96d23d Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Request method failure captured: Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments/39696e20-fd51-4a4a-8a4b-8999aa96d23d HTTP/1.1 Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gwQ4QdjvmzUUKlWXiNmje9RKWaTIy3epNypQPg9uU7U4SzRzp2w2-7jUbHrFcEIVawl1eGR2ZLmj-GvfDDp2HIaNrz8ok3Vsywa1Z04F2AdtvrEIuojHLR-t6_7pIyrP3iRNHpxc8K3XEh3WOEqpqVDv5KOUKEGBz6SwLEf7TTA-vQ Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: a4c201d8672b4b2dab2a3fe4ef1242ec Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-TestMinimumBasicScenario-972574263 Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:11:57.775104 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a4c201d8672b4b2dab2a3fe4ef1242ec", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4c201d8672b4b2dab2a3fe4ef1242ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a4c201d8672b4b2dab2a3fe4ef1242ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4c201d8672b4b2dab2a3fe4ef1242ec"}]}] Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-TestMinimumBasicScenario-972574263 Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: a4c201d8672b4b2dab2a3fe4ef1242ec Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-TestMinimumBasicScenario-972574263 Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-TestMinimumBasicScenario-972574263-project Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 54f8eea1619047d08651b6cbe0b11862 Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-TestMinimumBasicScenario-972574263-project Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:11:57.776791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 is not attached to volume 39696e20-fd51-4a4a-8a4b-8999aa96d23d Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'server_id': '99d43fe3-52d0-4ff7-b519-10abc0c30c97', 'id': '39696e20-fd51-4a4a-8a4b-8999aa96d23d'} Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 39696e20-fd51-4a4a-8a4b-8999aa96d23d. Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:11:57.777623 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 is not attached to volume 39696e20-fd51-4a4a-8a4b-8999aa96d23d Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 is not attached to volume 39696e20-fd51-4a4a-8a4b-8999aa96d23d Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:11:57.779170 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Returning 404 to user: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 is not attached to volume 39696e20-fd51-4a4a-8a4b-8999aa96d23d {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:11:57.780492 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d783d9ae-2418-4b66-bd9f-fa2aef294d2f tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "DELETE /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments/39696e20-fd51-4a4a-8a4b-8999aa96d23d" status: 404 len: 154 microversion: 2.1 time: 0.102211 Jul 28 04:11:57.780492 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 537/1095] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Jul 28 04:11:57 2022] DELETE /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97/os-volume_attachments/39696e20-fd51-4a4a-8a4b-8999aa96d23d => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:11:59.060921 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aae6a6f7-d126-4b3b-826a-c55aff804113 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:59.061492 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-aae6a6f7-d126-4b3b-826a-c55aff804113 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:59.068223 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aae6a6f7-d126-4b3b-826a-c55aff804113 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:59.068682 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aae6a6f7-d126-4b3b-826a-c55aff804113 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:59.069454 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aae6a6f7-d126-4b3b-826a-c55aff804113 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:59.069894 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aae6a6f7-d126-4b3b-826a-c55aff804113 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:59.096482 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-aae6a6f7-d126-4b3b-826a-c55aff804113 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:11:59.414832 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-aae6a6f7-d126-4b3b-826a-c55aff804113 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "DELETE /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 204 len: 0 microversion: 2.1 time: 0.357925 Jul 28 04:11:59.415431 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 559/1096] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:11:59 2022] DELETE /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:11:59.424524 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-c35cc9f0-768b-433a-a1bb-057729a9dd6e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:59.425190 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-c35cc9f0-768b-433a-a1bb-057729a9dd6e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:59.432091 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c35cc9f0-768b-433a-a1bb-057729a9dd6e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:59.432551 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c35cc9f0-768b-433a-a1bb-057729a9dd6e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:59.433334 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c35cc9f0-768b-433a-a1bb-057729a9dd6e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:59.433773 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-c35cc9f0-768b-433a-a1bb-057729a9dd6e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:59.568156 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-c35cc9f0-768b-433a-a1bb-057729a9dd6e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:59.575744 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-c35cc9f0-768b-433a-a1bb-057729a9dd6e tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1554 microversion: 2.1 time: 0.156043 Jul 28 04:11:59.576353 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 538/1097] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:59 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:00.598420 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-c293002e-c606-4f1c-9289-489505b4b164 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:00.599130 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-c293002e-c606-4f1c-9289-489505b4b164 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:00.606225 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c293002e-c606-4f1c-9289-489505b4b164 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:00.606698 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c293002e-c606-4f1c-9289-489505b4b164 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:00.607504 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c293002e-c606-4f1c-9289-489505b4b164 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:00.607976 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-c293002e-c606-4f1c-9289-489505b4b164 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:00.747305 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-c293002e-c606-4f1c-9289-489505b4b164 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:00.755722 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-c293002e-c606-4f1c-9289-489505b4b164 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1554 microversion: 2.1 time: 0.161591 Jul 28 04:12:00.756349 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 560/1098] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:00 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:01.776918 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-2b5fca0a-05cc-4a90-9354-2641e8c53967 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:01.777673 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-2b5fca0a-05cc-4a90-9354-2641e8c53967 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:01.785227 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2b5fca0a-05cc-4a90-9354-2641e8c53967 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:01.785721 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2b5fca0a-05cc-4a90-9354-2641e8c53967 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:01.787329 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2b5fca0a-05cc-4a90-9354-2641e8c53967 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:01.787791 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-2b5fca0a-05cc-4a90-9354-2641e8c53967 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:01.802567 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-5225e336-129f-414d-a21e-658dce4ea9e3 req-5b1db8d5-3bd1-4aae-b13d-307945710204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d43fe3-52d0-4ff7-b519-10abc0c30c97", "name": "network-vif-deleted", "tag": "74dfe64d-b519-4bc9-aa9c-521238e031fb"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:01.812571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-5225e336-129f-414d-a21e-658dce4ea9e3 req-5b1db8d5-3bd1-4aae-b13d-307945710204 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:01.813017 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-5225e336-129f-414d-a21e-658dce4ea9e3 req-5b1db8d5-3bd1-4aae-b13d-307945710204 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:01.826720 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-5225e336-129f-414d-a21e-658dce4ea9e3 req-5b1db8d5-3bd1-4aae-b13d-307945710204 service nova] Creating event network-vif-deleted:74dfe64d-b519-4bc9-aa9c-521238e031fb for instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 on hv-cinder-85127 Jul 28 04:12:01.833074 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-5225e336-129f-414d-a21e-658dce4ea9e3 req-5b1db8d5-3bd1-4aae-b13d-307945710204 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033990 Jul 28 04:12:01.833683 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 561/1099] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:12:01.869138 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-2b5fca0a-05cc-4a90-9354-2641e8c53967 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f8eea1619047d08651b6cbe0b11862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c201d8672b4b2dab2a3fe4ef1242ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:01.877977 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-2b5fca0a-05cc-4a90-9354-2641e8c53967 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 200 len: 1512 microversion: 2.1 time: 0.104894 Jul 28 04:12:01.878617 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 539/1100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:01 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 1512 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:02.900921 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:02.901533 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] [instance: 99d43fe3-52d0-4ff7-b519-10abc0c30c97] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:02.908224 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:02.908681 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:02.909455 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:02.909904 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:02.924629 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] HTTP exception thrown: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 could not be found. Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Request method failure captured: Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 HTTP/1.1 Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gwQ4QdjvmzUUKlWXiNmje9RKWaTIy3epNypQPg9uU7U4SzRzp2w2-7jUbHrFcEIVawl1eGR2ZLmj-GvfDDp2HIaNrz8ok3Vsywa1Z04F2AdtvrEIuojHLR-t6_7pIyrP3iRNHpxc8K3XEh3WOEqpqVDv5KOUKEGBz6SwLEf7TTA-vQ Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: a4c201d8672b4b2dab2a3fe4ef1242ec Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-TestMinimumBasicScenario-972574263 Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:12:02.926299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a4c201d8672b4b2dab2a3fe4ef1242ec", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4c201d8672b4b2dab2a3fe4ef1242ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a4c201d8672b4b2dab2a3fe4ef1242ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4c201d8672b4b2dab2a3fe4ef1242ec"}]}] Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-TestMinimumBasicScenario-972574263 Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: a4c201d8672b4b2dab2a3fe4ef1242ec Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-TestMinimumBasicScenario-972574263 Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-TestMinimumBasicScenario-972574263-project Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 54f8eea1619047d08651b6cbe0b11862 Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-TestMinimumBasicScenario-972574263-project Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 could not be found. Jul 28 04:12:02.927930 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '99d43fe3-52d0-4ff7-b519-10abc0c30c97'} Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 could not be found. Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:12:02.929599 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 could not be found. Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 could not be found. Jul 28 04:12:02.931118 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:12:02.937055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Returning 404 to user: Instance 99d43fe3-52d0-4ff7-b519-10abc0c30c97 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:12:02.937055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-bd50919a-63be-46f2-8365-53f188277e07 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97" status: 404 len: 111 microversion: 2.1 time: 0.031749 Jul 28 04:12:02.937055 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 562/1101] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:02 2022] GET /compute/v2.1/servers/99d43fe3-52d0-4ff7-b519-10abc0c30c97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:12:02.937388 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-d4737571-2462-4fff-a9b3-a7ed0e821898 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] Calling method '.version_select at 0x7f557b7b9f70>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:03.048498 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-d4737571-2462-4fff-a9b3-a7ed0e821898 tempest-TestMinimumBasicScenario-972574263 tempest-TestMinimumBasicScenario-972574263-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-999863052" status: 202 len: 0 microversion: 2.1 time: 0.115731 Jul 28 04:12:03.049087 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 540/1102] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Jul 28 04:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-999863052 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:12:15.979652 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:12:15.980303 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Thu Jul 28 04:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:13:01.105954 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-a43edf88-5a62-44ae-a738-d7ab5a8301e9 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:01.106706 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a43edf88-5a62-44ae-a738-d7ab5a8301e9 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:01.108941 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:01.109603 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG dbcounter [-] [135703] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=135703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:01.111152 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-00115be5-052f-445a-a46c-981a0b1955e7 req-21386bc9-92a5-4a18-88fe-8498fc641cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42", "tag": "dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:01.114856 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a43edf88-5a62-44ae-a738-d7ab5a8301e9 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.115571 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a43edf88-5a62-44ae-a738-d7ab5a8301e9 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.116377 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a43edf88-5a62-44ae-a738-d7ab5a8301e9 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.116818 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-a43edf88-5a62-44ae-a738-d7ab5a8301e9 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.120484 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_cell1:SELECT=32 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:01.130256 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG dbcounter [-] [135704] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=135704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:01.130256 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-00115be5-052f-445a-a46c-981a0b1955e7 req-21386bc9-92a5-4a18-88fe-8498fc641cb3 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.130256 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-00115be5-052f-445a-a46c-981a0b1955e7 req-21386bc9-92a5-4a18-88fe-8498fc641cb3 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.142800 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-00115be5-052f-445a-a46c-981a0b1955e7 req-21386bc9-92a5-4a18-88fe-8498fc641cb3 service nova] Creating event network-changed:dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc for instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 on hv-cinder-85127 Jul 28 04:13:01.147391 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-00115be5-052f-445a-a46c-981a0b1955e7 req-21386bc9-92a5-4a18-88fe-8498fc641cb3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041519 Jul 28 04:13:01.148230 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 541/1103] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:13:01.148631 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-a43edf88-5a62-44ae-a738-d7ab5a8301e9 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Going to try to terminate instance {{(pid=135703) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:13:01.554456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-a43edf88-5a62-44ae-a738-d7ab5a8301e9 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "DELETE /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 204 len: 0 microversion: 2.1 time: 0.452351 Jul 28 04:13:01.555212 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 563/1104] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:13:01 2022] DELETE /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:13:01.564970 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1f21f9b8-09bf-427a-9e15-86e43dd309cc tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:01.565841 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1f21f9b8-09bf-427a-9e15-86e43dd309cc tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:01.574291 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1f21f9b8-09bf-427a-9e15-86e43dd309cc tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.575133 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1f21f9b8-09bf-427a-9e15-86e43dd309cc tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.576034 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1f21f9b8-09bf-427a-9e15-86e43dd309cc tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.576550 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1f21f9b8-09bf-427a-9e15-86e43dd309cc tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.718754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-1f21f9b8-09bf-427a-9e15-86e43dd309cc tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:01.727418 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1f21f9b8-09bf-427a-9e15-86e43dd309cc tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1576 microversion: 2.1 time: 0.167056 Jul 28 04:13:01.728075 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 542/1105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:01 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:02.750501 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-fd54bd0d-3880-4f4e-a771-10441113c7eb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:02.751229 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-fd54bd0d-3880-4f4e-a771-10441113c7eb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:02.758282 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fd54bd0d-3880-4f4e-a771-10441113c7eb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:02.758731 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fd54bd0d-3880-4f4e-a771-10441113c7eb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:02.759497 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fd54bd0d-3880-4f4e-a771-10441113c7eb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:02.759932 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-fd54bd0d-3880-4f4e-a771-10441113c7eb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:02.910467 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-fd54bd0d-3880-4f4e-a771-10441113c7eb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:02.919440 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-fd54bd0d-3880-4f4e-a771-10441113c7eb tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1576 microversion: 2.1 time: 0.173012 Jul 28 04:13:02.920047 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 564/1106] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:02 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:03.941384 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [req-c0995838-d8d4-48e8-aa74-d2ad0678cb85 req-df3ec47f-15ba-4665-b42c-c135df5ae8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42", "name": "network-vif-deleted", "tag": "dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc"}]} {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:03.945834 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-87305b31-8256-418c-b210-50a9480ec862 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:03.947758 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-87305b31-8256-418c-b210-50a9480ec862 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:03.953585 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-c0995838-d8d4-48e8-aa74-d2ad0678cb85 req-df3ec47f-15ba-4665-b42c-c135df5ae8d4 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.954015 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [req-c0995838-d8d4-48e8-aa74-d2ad0678cb85 req-df3ec47f-15ba-4665-b42c-c135df5ae8d4 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.957223 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-87305b31-8256-418c-b210-50a9480ec862 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.957686 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-87305b31-8256-418c-b210-50a9480ec862 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.958498 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-87305b31-8256-418c-b210-50a9480ec862 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.959067 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-87305b31-8256-418c-b210-50a9480ec862 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.967254 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.compute.server_external_events [req-c0995838-d8d4-48e8-aa74-d2ad0678cb85 req-df3ec47f-15ba-4665-b42c-c135df5ae8d4 service nova] Creating event network-vif-deleted:dc9e4aa1-0cfe-4e20-9a8e-52fd38a2b2fc for instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 on hv-cinder-85127 Jul 28 04:13:03.972692 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [req-c0995838-d8d4-48e8-aa74-d2ad0678cb85 req-df3ec47f-15ba-4665-b42c-c135df5ae8d4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035223 Jul 28 04:13:03.973296 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 543/1107] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:13:04.038452 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-87305b31-8256-418c-b210-50a9480ec862 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:04.049059 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-87305b31-8256-418c-b210-50a9480ec862 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1390 microversion: 2.1 time: 0.110173 Jul 28 04:13:04.049680 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 565/1108] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:03 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1390 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:05.072151 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:05.073010 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:05.079481 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:05.079941 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:05.080754 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:05.081198 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:05.113367 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:05.113842 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:05.114286 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.objects.instance [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lazy-loading 'fault' on Instance uuid 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 {{(pid=135704) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:13:05.158764 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:05.166259 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-194e4a38-73d0-4113-a7c7-4f640a32a190 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 200 len: 1184 microversion: 2.1 time: 0.099058 Jul 28 04:13:05.166839 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 544/1109] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:05 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 1184 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:06.189371 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:06.189983 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:06.196754 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:06.197216 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:06.198003 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:06.198456 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:06.212979 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] HTTP exception thrown: Instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 could not be found. Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Request method failure captured: Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 HTTP/1.1 Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gsm384Sc59-EMBvKFVbWJMVnjPyHZjPKRsUv920lVHIckgHNIj9CAQfbyPesoWWIBkpaOFgMvUC3rwshhd-rH2Gx2zwW2oAnU5U2zQP3xYgqtDcwTmGse7thAR2MojKZ1g3CYEmNWRnOhqrDxbne8Y_b_dQxF_naBkxwp4S437IjlM Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:13:06.214734 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9aa592e1b58f4804ad264f0cd721b1ca", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}] Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 44734ee22727449fafcd470798c10abd Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 could not be found. Jul 28 04:13:06.221719 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42'} Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 could not be found. Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:13:06.222829 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 could not be found. Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 could not be found. Jul 28 04:13:06.224614 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.226165 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Returning 404 to user: Instance 25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:13:06.226165 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-0e3c12b8-dc68-41e2-a57f-c9a82a661605 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42" status: 404 len: 111 microversion: 2.1 time: 0.031521 Jul 28 04:13:06.226165 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 566/1110] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:06 2022] GET /compute/v2.1/servers/25d2a2f6-2f5e-49d7-bc8b-675e9fc4de42 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:09.601445 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ed153498-4c9d-43ba-b319-decc17417e36 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:09.601962 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ed153498-4c9d-43ba-b319-decc17417e36 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:09.608944 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed153498-4c9d-43ba-b319-decc17417e36 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.609656 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed153498-4c9d-43ba-b319-decc17417e36 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.610244 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-b64be804-4629-4a8f-be20-c2505c0cf9c5 req-48f3271e-65f7-4a70-a43d-75aa3a12a399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa34a319-36da-4d32-879f-76740e89aecc", "tag": "bf07003f-197f-47fc-987f-30b50dad1a5e"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:09.610722 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed153498-4c9d-43ba-b319-decc17417e36 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.611159 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ed153498-4c9d-43ba-b319-decc17417e36 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.620728 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-b64be804-4629-4a8f-be20-c2505c0cf9c5 req-48f3271e-65f7-4a70-a43d-75aa3a12a399 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.621175 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-b64be804-4629-4a8f-be20-c2505c0cf9c5 req-48f3271e-65f7-4a70-a43d-75aa3a12a399 service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.633015 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-b64be804-4629-4a8f-be20-c2505c0cf9c5 req-48f3271e-65f7-4a70-a43d-75aa3a12a399 service nova] Creating event network-changed:bf07003f-197f-47fc-987f-30b50dad1a5e for instance fa34a319-36da-4d32-879f-76740e89aecc on hv-cinder-85127 Jul 28 04:13:09.638387 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ed153498-4c9d-43ba-b319-decc17417e36 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Going to try to terminate instance {{(pid=135704) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:13:09.639530 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-b64be804-4629-4a8f-be20-c2505c0cf9c5 req-48f3271e-65f7-4a70-a43d-75aa3a12a399 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033148 Jul 28 04:13:09.640481 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 567/1111] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:09.949009 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ed153498-4c9d-43ba-b319-decc17417e36 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 204 len: 0 microversion: 2.1 time: 0.350672 Jul 28 04:13:09.951018 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 545/1112] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:13:09 2022] DELETE /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:13:09.960351 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-5a533619-dfe2-4d8b-8f14-680d136d7da5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:09.961141 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-5a533619-dfe2-4d8b-8f14-680d136d7da5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:09.969239 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a533619-dfe2-4d8b-8f14-680d136d7da5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.970065 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a533619-dfe2-4d8b-8f14-680d136d7da5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.971165 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a533619-dfe2-4d8b-8f14-680d136d7da5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.971809 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-5a533619-dfe2-4d8b-8f14-680d136d7da5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:10.115843 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.policy [None req-5a533619-dfe2-4d8b-8f14-680d136d7da5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135703) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:10.123886 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-5a533619-dfe2-4d8b-8f14-680d136d7da5 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1575 microversion: 2.1 time: 0.168551 Jul 28 04:13:10.124475 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 568/1113] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:09 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:11.145833 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-846c2cb5-93c6-4492-84eb-8e5042a1c1a3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:11.146613 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-846c2cb5-93c6-4492-84eb-8e5042a1c1a3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:11.153350 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-846c2cb5-93c6-4492-84eb-8e5042a1c1a3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:11.153901 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-846c2cb5-93c6-4492-84eb-8e5042a1c1a3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:11.154945 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-846c2cb5-93c6-4492-84eb-8e5042a1c1a3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:11.155133 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-846c2cb5-93c6-4492-84eb-8e5042a1c1a3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:11.295614 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-846c2cb5-93c6-4492-84eb-8e5042a1c1a3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:11.302938 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-846c2cb5-93c6-4492-84eb-8e5042a1c1a3 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1575 microversion: 2.1 time: 0.161425 Jul 28 04:13:11.305752 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 546/1114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:11 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:12.241383 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [req-cf4fbd29-4818-4e97-bb0b-2f2d18c6571c req-bfbd6f05-e5f0-4bce-a0d2-0c078767b6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa34a319-36da-4d32-879f-76740e89aecc", "name": "network-vif-deleted", "tag": "bf07003f-197f-47fc-987f-30b50dad1a5e"}]} {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:12.252484 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-cf4fbd29-4818-4e97-bb0b-2f2d18c6571c req-bfbd6f05-e5f0-4bce-a0d2-0c078767b6bb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:12.252935 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [req-cf4fbd29-4818-4e97-bb0b-2f2d18c6571c req-bfbd6f05-e5f0-4bce-a0d2-0c078767b6bb service nova] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:12.265117 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.compute.server_external_events [req-cf4fbd29-4818-4e97-bb0b-2f2d18c6571c req-bfbd6f05-e5f0-4bce-a0d2-0c078767b6bb service nova] Creating event network-vif-deleted:bf07003f-197f-47fc-987f-30b50dad1a5e for instance fa34a319-36da-4d32-879f-76740e89aecc on hv-cinder-85127 Jul 28 04:13:12.270230 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [req-cf4fbd29-4818-4e97-bb0b-2f2d18c6571c req-bfbd6f05-e5f0-4bce-a0d2-0c078767b6bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032935 Jul 28 04:13:12.270841 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 569/1115] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:12.325457 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ef419da4-47b1-48b1-8fd0-ab8d8ae202de tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:12.326063 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-ef419da4-47b1-48b1-8fd0-ab8d8ae202de tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:12.332712 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef419da4-47b1-48b1-8fd0-ab8d8ae202de tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:12.333174 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef419da4-47b1-48b1-8fd0-ab8d8ae202de tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:12.334028 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef419da4-47b1-48b1-8fd0-ab8d8ae202de tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:12.334478 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-ef419da4-47b1-48b1-8fd0-ab8d8ae202de tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:12.399981 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.policy [None req-ef419da4-47b1-48b1-8fd0-ab8d8ae202de tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44734ee22727449fafcd470798c10abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa592e1b58f4804ad264f0cd721b1ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=135704) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:12.408332 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ef419da4-47b1-48b1-8fd0-ab8d8ae202de tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 200 len: 1388 microversion: 2.1 time: 0.086901 Jul 28 04:13:12.408918 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 547/1116] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:12 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:13.435245 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:13.440531 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: fa34a319-36da-4d32-879f-76740e89aecc] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:13.442731 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.443182 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.444021 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.444420 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.459628 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] HTTP exception thrown: Instance fa34a319-36da-4d32-879f-76740e89aecc could not be found. Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Request method failure captured: Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc HTTP/1.1 Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gsm384Sc59-EMBvKFVbWJMVnjPyHZjPKRsUv920lVHIckgHNIj9CAQfbyPesoWWIBkpaOFgMvUC3rwshhd-rH2Gx2zwW2oAnU5U2zQP3xYgqtDcwTmGse7thAR2MojKZ1g3CYEmNWRnOhqrDxbne8Y_b_dQxF_naBkxwp4S437IjlM Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:13:13.461390 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9aa592e1b58f4804ad264f0cd721b1ca", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}] Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 44734ee22727449fafcd470798c10abd Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance fa34a319-36da-4d32-879f-76740e89aecc could not be found. Jul 28 04:13:13.463070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': 'fa34a319-36da-4d32-879f-76740e89aecc'} Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa34a319-36da-4d32-879f-76740e89aecc could not be found. Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:13:13.464045 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa34a319-36da-4d32-879f-76740e89aecc could not be found. Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa34a319-36da-4d32-879f-76740e89aecc could not be found. Jul 28 04:13:13.465816 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:13.467352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Returning 404 to user: Instance fa34a319-36da-4d32-879f-76740e89aecc could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:13:13.467352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-aceca2bb-ad3c-4e11-8030-3ef409e6113a tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc" status: 404 len: 111 microversion: 2.1 time: 0.033075 Jul 28 04:13:13.467352 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 570/1117] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:13 2022] GET /compute/v2.1/servers/fa34a319-36da-4d32-879f-76740e89aecc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:14.056314 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:14.056931 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.compute.api [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135704) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:14.063750 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.064244 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.065141 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.065581 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG oslo_concurrency.lockutils [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135704) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.081632 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.wsgi [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] HTTP exception thrown: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Request method failure captured: Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: request: DELETE /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 HTTP/1.1 Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept: application/json Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Accept-Encoding: identity Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Connection: close Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Length: 0 Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Content-Type: application/json Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Host: 10.222.0.66 Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Openstack-System-Scope: None Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: User-Agent: python-urllib3/1.26.10 Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Auth-Token: gAAAAABi4gsm384Sc59-EMBvKFVbWJMVnjPyHZjPKRsUv920lVHIckgHNIj9CAQfbyPesoWWIBkpaOFgMvUC3rwshhd-rH2Gx2zwW2oAnU5U2zQP3xYgqtDcwTmGse7thAR2MojKZ1g3CYEmNWRnOhqrDxbne8Y_b_dQxF_naBkxwp4S437IjlM Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Id: None Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Domain-Name: None Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Identity-Status: Confirmed Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Is-Admin-Project: True Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Id: default Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Domain-Name: Default Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Project-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Role: reader,member Jul 28 04:13:14.083583 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Roles: reader,member Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9aa592e1b58f4804ad264f0cd721b1ca", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}] Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-Tenant-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Id: default Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Domain-Name: Default Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Id: 44734ee22727449fafcd470798c10abd Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: X-User-Name: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: method: > Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: exception: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.085249 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: action_args: {'id': '7b0538a6-ada9-4f1f-b47c-1aa7b6678a62'} Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:13:14.086202 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.087758 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.089297 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Returning 404 to user: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. {{(pid=135704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:13:14.089297 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-1374c0a4-dc1e-4b72-98e1-2838696e2c2f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 404 len: 111 microversion: 2.1 time: 0.032660 Jul 28 04:13:14.089297 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 548/1118] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Jul 28 04:13:14 2022] DELETE /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:14.094451 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '>' {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:14.095070 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.compute.api [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] [instance: 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62] Fetching instance by UUID {{(pid=135703) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:13:14.101273 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.101791 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.102577 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.103024 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG oslo_concurrency.lockutils [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Lock "0e515933-bed8-4837-a392-d3420c11c3a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=135703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.117858 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.wsgi [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] HTTP exception thrown: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Request method failure captured: Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: request: GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 HTTP/1.1 Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept: application/json Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Accept-Encoding: identity Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Connection: close Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Length: 0 Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Content-Type: application/json Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Host: 10.222.0.66 Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Openstack-System-Scope: None Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: User-Agent: python-urllib3/1.26.10 Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Auth-Token: gAAAAABi4gsm384Sc59-EMBvKFVbWJMVnjPyHZjPKRsUv920lVHIckgHNIj9CAQfbyPesoWWIBkpaOFgMvUC3rwshhd-rH2Gx2zwW2oAnU5U2zQP3xYgqtDcwTmGse7thAR2MojKZ1g3CYEmNWRnOhqrDxbne8Y_b_dQxF_naBkxwp4S437IjlM Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Id: None Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Domain-Name: None Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Identity-Status: Confirmed Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Is-Admin-Project: True Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Id: default Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Domain-Name: Default Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Project-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Role: reader,member Jul 28 04:13:14.119395 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Roles: reader,member Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9aa592e1b58f4804ad264f0cd721b1ca", "adminURL": "http://10.222.0.66:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9aa592e1b58f4804ad264f0cd721b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9aa592e1b58f4804ad264f0cd721b1ca"}]}] Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Id: 9aa592e1b58f4804ad264f0cd721b1ca Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-Tenant-Name: tempest-TestVolumeBootPattern-414401148 Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Id: default Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Domain-Name: Default Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Id: 44734ee22727449fafcd470798c10abd Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: X-User-Name: tempest-TestVolumeBootPattern-414401148-project Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: method: > Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: exception: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.121364 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: action_args: {'id': '7b0538a6-ada9-4f1f-b47c-1aa7b6678a62'} Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: {{(pid=135703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:13:14.122466 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. Jul 28 04:13:14.124005 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: ERROR nova.api.openstack.wsgi Jul 28 04:13:14.125356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: DEBUG nova.api.openstack.wsgi [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Returning 404 to user: Instance 7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 could not be found. {{(pid=135703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:13:14.125356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO nova.api.openstack.requestlog [None req-9b7b670c-9984-428b-b3b3-01c2c98d7d3f tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62" status: 404 len: 111 microversion: 2.1 time: 0.030950 Jul 28 04:13:14.125356 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: [pid: 135703|app: 0|req: 571/1119] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:14 2022] GET /compute/v2.1/servers/7b0538a6-ada9-4f1f-b47c-1aa7b6678a62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:15.664333 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: DEBUG nova.api.openstack.wsgi [None req-ebc8191c-637e-4e9b-92e2-c44338896871 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] Calling method '.version_select at 0x7f5572fe1a60>' {{(pid=135704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:15.748955 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO nova.api.openstack.requestlog [None req-ebc8191c-637e-4e9b-92e2-c44338896871 tempest-TestVolumeBootPattern-414401148 tempest-TestVolumeBootPattern-414401148-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-743574221" status: 202 len: 0 microversion: 2.1 time: 0.088674 Jul 28 04:13:15.749540 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: [pid: 135704|app: 0|req: 549/1120] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Jul 28 04:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-743574221 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:14:07.055201 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:14:07.055893 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Thu Jul 28 04:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:15:35.989669 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:15:35.990299 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Thu Jul 28 04:15:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:15:46.624607 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:15:46.625282 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Thu Jul 28 04:15:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:16:02.971292 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:16:02.972063 dv-cinder-851279-1-iscsi devstack@n-api.service[135703]: Thu Jul 28 04:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:16:11.162529 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:16:11.163220 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Thu Jul 28 04:16:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:17:27.063706 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:17:27.064426 dv-cinder-851279-1-iscsi devstack@n-api.service[135704]: Thu Jul 28 04:17:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!